E-Series Performance Analyzer (EPA) v4 beta
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
Posts by Tag
- netapp 233
- solidfire 138
- eseries 87
- e-series 81
- s3 67
- backup 43
- api 41
- monitoring 39
- trident 38
- storagegrid 35
- csi 31
- beegfs 29
- data protection 28
- powershell 24
- python 20
- devops 19
- kubernetes 18
- hci 18
- iscsi 17
- automation 17
- performance 15
- visualization 14
- ontap 14
- replication 14
- grafana 14
- snapshot 14
- restore 13
- elasticsearch 12
- velero 12
- santricity 12
- analytics 11
- storage 10
- log 9
- minio 9
- influxdb 9
- epa 9
- ai 9
- workflow 8
- windows 8
- plugin 7
- elk 7
- arm64 7
- prometheus 7
- visualize 7
- hyper-v 7
- sfc 7
- vmware 6
- sizing 6
- docker 6
- sync 6
- audit 6
- linux 6
- nomad 6
- NetApp 6
- SolidFire 6
- ef-series 6
- rancher 5
- hcc 5
- kasten 5
- networking 5
- vsphere 5
- splunk 5
- database 5
- ddp 5
- redhat 5
- observability 5
- ontap s3 5
- proxmox 5
- efficiency 5
- search 5
- instaclustr 5
- Kubernetes 5
- E-Series 5
- versity 5
- clone 5
- zfs 5
- netapp storagegrid 5
- terraform 4
- logging 4
- restic 4
- kopia 4
- snmp 4
- ilm 4
- hadoop 4
- caching 4
- hashicorp 4
- k8s 4
- consistency group 4
- vector 4
- netapp hci 4
- provider 3
- nginx 3
- kanister 3
- registry 3
- container registry 3
- hcicollector 3
- dr 3
- cloudsync 3
- cloud sync 3
- security 3
- alluxio 3
- ram cache 3
- ansible 3
- parquet 3
- spot.io 3
- kafka 3
- capacity 3
- compression 3
- hybrid cloud 3
- DevOps 3
- ransomware 3
- Kasten 3
- gateway 3
- version 3
- object store 3
- indexing 3
- sql server 3
- data 3
- embedding 3
- rag 3
- qos 2
- fc 2
- benchmark 2
- veeam 2
- vm 2
- smartstore 2
- PowerShell 2
- duplicati 2
- kvm 2
- management 2
- rclone 2
- go 2
- quay 2
- hdfs 2
- cloud 2
- rbac 2
- data management 2
- xcp-ng 2
- apptainer 2
- rocky linux 2
- rocky 2
- lxd 2
- password 2
- syslog 2
- event 2
- ssd 2
- wear 2
- flash 2
- Cloud Sync 2
- CloudSync 2
- ELK 2
- Trident 2
- CSI 2
- unmap 2
- rethin 2
- logstash 2
- versioning 2
- compliance 2
- ec 2
- erasure coding 2
- b2 2
- versitygw 2
- snapshot volume 2
- snapshot image 2
- postgresql 2
- ubuntu 2
- hooks 2
- swagger 2
- openapi 2
- longhorny 2
- mcp 2
- pipeline 2
- clamav 2
- knn 2
- similarity 2
- s3 vectors 2
- windows admin center 2
- github 1
- dark mode 1
- certificate 1
- postman 1
- fibre channel 1
- f5 1
- ingress 1
- k10 1
- vlan 1
- diskspd 1
- object versioning 1
- nutanix 1
- cloud backup service 1
- cloud backup 1
- cbs 1
- ontap select 1
- helm 1
- storage efficiency 1
- vertica 1
- exporter 1
- solidfire-exporter 1
- bc 1
- edge 1
- photon iot 1
- cloud mirror 1
- mirantis 1
- ha 1
- az 1
- pd 1
- protection domain 1
- failure domain 1
- mvip 1
- svip 1
- duplicacy 1
- onecollect 1
- chap 1
- iqn 1
- alerting 1
- telegraf 1
- sgac 1
- insight 1
- cache 1
- digital ocean 1
- flatcar 1
- coreos 1
- servicenow 1
- rsync 1
- nextcloud 1
- cve 1
- wasabi 1
- gitops 1
- openstack 1
- cinder 1
- xena 1
- provisioning 1
- driver 1
- sql select 1
- csv 1
- sql 1
- activeiq 1
- aiq 1
- photon 1
- curl 1
- s3tester 1
- kestra 1
- jupyter 1
- report 1
- platform 1
- pmk 1
- rest server 1
- lvm 1
- ephemeral 1
- rest 1
- object lock 1
- tanzu 1
- economics 1
- apache 1
- ozone 1
- milvus 1
- lnn 1
- vector database 1
- cassandra 1
- xen 1
- xen server 1
- QoS 1
- nextflow 1
- oracle 1
- timesten 1
- storage network 1
- sbom 1
- container 1
- weka 1
- weka.io 1
- eoa 1
- end of availability 1
- tensorstore 1
- cloudflare 1
- workers 1
- containers 1
- watch 1
- fsnotify 1
- hsm 1
- irods 1
- jwt 1
- auth 1
- token 1
- login 1
- script 1
- directpv 1
- topolvm 1
- lvm csi 1
- forwarding 1
- mel 1
- beeegfs 1
- spot 1
- reporting 1
- scripting 1
- overprovisioning 1
- Docker 1
- Nomad 1
- data broker 1
- metrics 1
- Elastic 1
- Elasticsearch 1
- KubeVirt 1
- VolSync 1
- synchronization 1
- projects 1
- elastic 1
- Kanister 1
- S3 1
- mountpoint-s3 1
- nfs 1
- flatcar linux 1
- cloudcasa 1
- pvc 1
- cbl-mariner 1
- azure 1
- worm 1
- thanos 1
- proxy 1
- squid 1
- reverse proxy 1
- forward proxy 1
- fscrawler 1
- filesytem 1
- DDP 1
- pool 1
- preservation 1
- expand 1
- shrink 1
- gpt 1
- generative ai 1
- h2o 1
- lln 1
- statefulset 1
- retention 1
- policy 1
- snapmirror 1
- polybase 1
- memphis 1
- broker 1
- message broker 1
- queue 1
- streaming 1
- memphis.dev 1
- teradata 1
- nos 1
- delta lake 1
- json 1
- vantage 1
- volumemode 1
- fileystem 1
- btrfs 1
- backblaze 1
- sample 1
- volume 1
- synthetic 1
- dpp 1
- ef300 1
- ef600 1
- simple backups 1
- simplebackups 1
- mib 1
- oid 1
- INF-01-00 1
- rdma 1
- iser 1
- prtg 1
- traps 1
- custom 1
- cg 1
- volume group 1
- raid1 1
- raid6 1
- r10 1
- r1 1
- repository 1
- RAID 1 1
- RAID 6 1
- R1 1
- pgbench 1
- e-series perf analyzer 1
- psu 1
- temperature 1
- sensors 1
- hec 1
- http event collector 1
- element 1
- postgres 1
- pgvector 1
- RAG 1
- nvidia 1
- delegation 1
- roles 1
- trim 1
- retrim 1
- ntfs 1
- sdelete 1
- pytorch 1
- torch 1
- load 1
- save 1
- distributed 1
- checkpoint 1
- dcp 1
- autoscaling 1
- keda 1
- hardened 1
- AV 1
- antivirus 1
- antimalware 1
- scan 1
- virus 1
- malware 1
- sds 1
- broadcom 1
- licensing 1
- notifications 1
- confluent 1
- fast_dedup 1
- dedup 1
- incus 1
- media scan 1
- grok 1
- xfs 1
- block size 1
- verda 1
- ssd cache 1
- best practices 1
- firewall 1
- beegfs csi 1
- elementos 1
- json-rpc 1
- jsonrpc 1
- 123456 1
- histograms 1
- schedule 1
- failover 1
- failback 1
- aws 1
- rcos 1
- openshift 1
- ublock 1
- red dot 1
- netapp e-series 1
- volume copy 1
- harvest 1
- cloudera 1
- tiering 1
- deduplication 1
- agent 1
- opea 1
- 2025 1
- server 1
- data pipeline 1
- thinkparq 1
- mlops 1
- stack 1
- reference 1
- spark 1
- TR-4890 1
- scanning 1
- enumeration 1
- aistor 1
- pve 1
- group snapshot 1
- opensearch 1
- hcl 1
- EPA 1
netapp
SolidFire Extension for Windows Admin Center 2025
Introduction Walk-through And now… Conclusion Appendix A: demo Animated GIF (no playback control) Video demo with voice-over ...
SolidFire Gateway for Windows Admin Center 2025
Introduction What it is What it does IIS Setup Why this matters What about it? Conclusion
Updated Terraform provider for SolidFire
Introduction What's new in 2025 Next steps
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 vector search - DIY vs AWS S3 Vectors
This is a two-part post:
The shocking truth about SolidFire ModifySchedule method
Introduction Show me Why? Thoughts Conclusion
Firemox - an anti-plugin for Proxmox PVE with NetApp SolidFire
Background Firemox What it does, and doesn't (Stopping) scope creep Known issues and limitations Conclusion Demo and source c...
SolidFire backup to disk with Versity S3 Gateway
This is more appropriate for a tweet, but anyway…
Do we need a NetApp SolidFire plugin for Proxmox
Who wants it and why? Perl for the win! Features Effort Appendix A: what works and how Appendix B: observations, problems, solutions Appendix ...
Data pipeline with BeeGFS FS Event Notifications and Versity S3 Gateway
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Improved pipelines with BeeGFS FS Event Notifications in v8
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
Simple file share and S3 analytics and MCP ops
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Windows Server 2025 with NetApp SolidFire
I wrote about Windows Server 2025 here.
OPEA AI with NetApp E-Series
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
Build NetApp SolidFire MCP server
Introduction MCP Use cases? Get, set, and security Conclusion Additional reading
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Cloudera Base with NetApp E-Series
Introduction Reference architectures High-level design and best practices What's new in Cloudera Base Deployment topology Sizin...
Minimal Prometheus Exporter with ONTAP Harvest
Introduction Approach Steps One or more instances Prepare your box Clone Harvest repo or download pre-built container image ...
InfluxDB 3 Core Alpha available for testing
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
MinIO and Versity S3 GW with tiny object workloads on NetApp E-Series
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
Convert NetApp HCI from VMware to Hyper-V
Requirement Workflow Storage considerations Tools
Boot OpenShift RCOS from NetApp SolidFire iSCSI target
Introduction How Other SolidFire-related tips Conclusion
Velero AWS Plugin and SignatureDoesNotMatch nonsense
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Kubefire - tools and recipes for Kubernetes failover/failback with SolidFire
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
Extract SolidFire volume attributes created by Trident or other apps
This series of posts has several parts:
Increase size of SolidFire volumes paired for replication
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
SolidFire Collector v2.0.0 is ready
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Make use of storage QoS histograms on NetApp SolidFire
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Use Telegraf to send NetApp SolidFire metrics to InfluxDB
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Access NetApp SolidFire API with Async IO
Introduction
Towards next SolidFire Collector (SFC)
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Tenant (account) attributes on NetApp SolidFire
It took me a while
Swagger files for NetApp E-Series
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
OpenAPI and SolidFire
SolidFire doesn't have an OpenAPI interface. See here.
Metrics for NetApp SolidFire backup-to-S3 in InfluxDB and Grafana
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
NetApp SolidFire Collector with Grafana 11
You may have heard Grafana 11 is coming out soon.
EConfig v2
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
Backup NetApp SolidFire's non-Kubernetes volumes with Velero
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
NetApp StorageGRID networks
Introduction
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Two
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Three
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Quickly install NetApp Trident v24.02 on ARM64 Kubernetes
Here we go again…
Monitor progress and notify of E-Series media scan events
Introduction SANtricity API methods related to scrubbing, scanning, fixing data issues Media scan in Web UI Relevant API methods Implementation ...
Ubuntu 24.04 LTS with NetApp SolidFire
Introduction Create, discover, login Efficiency - zpools on SoliFire vs global SolidFire efficiencies Comparison with XFS and BTRFS ...
Ubuntu 24.04 LTS with NetApp SolidFire
Introduction Create, discover, login Efficiency - zpools on SoliFire vs global SolidFire efficiencies Comparison with XFS and BTRFS ...
ZFS with NetApp E-Series
Introduction What is E-Series anyway Easy storage management Conclusion
ZFS deduplication with NetApp E-Series
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
Scan NetApp StorageGRID S3 buckets for viruses and malware
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
NetApp E-Series DAS or SAN storage as Veeam Hardened Repository
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
NetApp SolidFire backup to S3 and MinIO compression savings
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Containerized BeeGFS with NetApp E-Series
Introduction
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
NetApp SolidFire with GenAI and inferencing workloads
Introduction Inferencing with SolidFire Examples Making use of iSCSI Share data with a parallel file system Share ...
Calculate snapshot capacity utilization on NetApp SolidFire
Introduction Clone and analyze Example with Postgres writeBytes metric Cost issue Do we still need to clone those snapshots? How to minimize s...
Monitor Snapshot Consistency Groups of NetApp E-Series SANtricity OS
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Faster PostgreSQL with DDP-based RAID 1 compared to DDP-based RAID 6
Introduction Environment Tests Results Other performance views Conclusion
Monitor snapshot and clone repositories of NetApp E-Series SANtricity OS
Problem statement Considerations First iteration Second iteration Conclusion
Benefits of RAID 1 in E-Series DDP
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
Ubuntu 22.04 LTS as iSER client to NetApp E-Series
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
Event monitoring with SNMP trap notifications from NetApp E-Series arrays
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
Velero 1.12 and CSI Snapshot Data Movement with NetApp SolidFire
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
ThinkParQ takes over NetApp-created BeeGFS CSI driver
I've written several posts about NetApp's BeeGFS CSI driver.
MinIO Erasure Coding with NetApp E-Series
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
Use SolidFire API to monitor clone and backup jobs for profit and pleasure
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
SolidFire backup-to-S3 using ONTAP S3 destination
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
StatefulSet PVC Retention with Trident and SolidFire
Introduction
StatefulSet PVC Retention with Trident and SolidFire
Introduction
Basic notes on h2o GPT from a storage perspective
So… I don't use Generative AI.
What's new in NetApp Trident v23.07
Introduction
Use ONTAP S3 as backup destination for Velero
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
StorageGRID and Elasticsearches
Why "Elasticsearches"?
Azure Linux with SolidFire iSCSI targets
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
CloudCasa, Velero, NetApp Trident, and SolidFire
Table of Contents
Using snapshot attributes in SolidFire
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
Use cases for AWS mountpoint-s3 with NetApp E-Series and SolidFire
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Elasticsearch performance with E-Series
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Backup/restore E-Series Performance Analyzer with Kasten K10
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Store Kasten backups on NetApp E-Series
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
Flash media overprovisioning on NetApp E-Series
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
Monitor wear level of NetApp E-Series flash drives via the API and from the CLI
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
GA of SolidFire 12.7
SolidFire and eSDS (containerized SolidFire for 3rd party x86 servers) version 12.7 was released in late October, but I haven't blogged about it.
SSD disk wear indicator in E-Series SANtricity 11.70
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
NetApp BeeGFS CSI driver 1.4.0
This week NetApp released BeeGFS CSI driver v1.4.0 which adds support for newer Kubernetes and BeeGFS.
Gathering and forwarding E-Series SANtricity Major Event Log (MEL)
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
Prometheus exporter for NetApp E-Series SANtricity OS
NetApp E-Series Prometheus Exporter
Forward E-Series SANtricity logs to remote syslog server
Configure SANtricity to send array events to a remote syslog server
E-Series in a Kubernetes environment with DirectPV, TopoLVM, CSI Driver LVM CSI drivers
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
PowerShell password change script for local user account on E-Series SANtricity OS
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
On-prem Spot Instaclustr-managed clusters with NetApp E-Series storage
Introduction Compute layer and storage interconnect Small and large clusters HDDs, SSDs, RAID, DDP… How to automate E-Series volume provisioning t...
E-Series SANtricity API with JWT aka Bearer Tokens
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
Rocky Linux 8 and 9 added to NetApp E-Series interoperability matrix
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
Notes on MinIO performance with NetApp E-Series
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
iRODS or Robinhood HSM with BeeGFS
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
Velero 1.9 with AWS and CSI plugins for ARM64
Introduction Non-CSI with Restic and NetApp BeeGFS CSI CSI with NetApp Trident What's new in 1.9 and 1.8 Velero on ARM64 Restic (ARM64)...
Hybrid cloud scenarios with Cloudflare serverless
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
Speed of volume creation with BeeGFS CSI
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
NetApp Trident v22.07.0 for ARM64
I had thought the posts I wrote about Trident on ARM64 were enough to get almost everyone going, but it seems it's not hard to get stuck.
Low-hanging BeeGFS efficiency fruit
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
TensorStore with BeeGFS
TensorStore is a new C++ and Python library that provides a uniform API for reading and writing n-dimensional data.
End of Availability for SolidFire
This week NetApp released product communique CPC-00467 (NetApp support portal login required) on end of availability of SolidFire.
DDP capacity splitter for E-Series
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
New Dynamic Disk Pool configuration and E-Series SANtricity
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
Brute force sizing NetApp E-Series
Introduction Considerations Create configuration options Choice of query tool Show available options Query capacity range Manual selection of ...
SolidFire Backup to S3 over Storage Network
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
Configuration approaches to NetApp E-Series with ThinkParQ BeeGFS
It may not be easy to digest how BeeGFS with NetApp E-Series is usually configured.
Send BeeGFS and NetApp E-Series performance metrics to InfluxDB v2 or scrape them form Prometheus
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Leverage BeeGFS in Nextflow to avoid unnecessary data movement
Nextflow configuration and environment variables allow us to make use of BeeGFS with E-Series for most demanding IO tasks.
Simple S3 service endpoint for BeeGFS using Hashicorp Nomad and stand-alone MinIO
I have a small Nomad cluster which can access a BeeGFS filesystem.
Apptainer with BeeGFS
Apptainer is based on the Singularity project.
Display per-storage node performance guarantees of SolidFire nodes
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
XCP-ng and XOA with NetApp SolidFire iSCSI Storage Repositories
Introduction XCP-NG with SolidFire XOA Conclusion
Cassandra with SolidFire and E-Series
Introduction
Milvus with SolidFire and E-Series
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
Apache Ozone S3 and NetApp E-Series
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
Storage efficiency with Kafka 3.2 and NetApp SolidFire 12
Objective How I tested Kafka tests and results Random ASCII records StorageGRID audit log Protecting Kafka on a single site...
E-Series as Tier One for multi-tiered Kafka clusters
Multi-tiered storage in Kafka clusters How to leverage E-Series Performance vs. data protection overhead Sequential performance vs. lat...
Apache Hadoop 3 with NetApp E-Series
HDFS Durability and External Protected Storage Does everyone need RF2 HDFS Erasure Coding Compression NFS gateway Snapsho...
Copy files to/from BeeGFS before or after scheduled jobs
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
The new Kasten K10 v5.0 with NetApp SolidFire
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
Rightsizing compute resources in the cloud with Spot.io
Most cloud users know about the various options to rent cloud compute resources.
Kubernetes with vSphere CSI Plugin and NetApp E-Series
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
GA of SolidFire 12.5
SolidFire and eSDS (containerized SolidFire for 3rd party x86 servers) version 12.5 just came out.
SolidFire Backup to S3 with Object Lock
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
Trident CSI REST API
Why access Trident API Controller routes Trident resources Expose the Trident REST API Examples What about it Appendix: List of Trident Resour...
SolidFire Collector on Kubernetes
What is SFC Making SolidFire Collector work with Kubernetes Appendix: Deploymennt for SFC and Graphite
BeeGFS and BeeGFS CSI on ARM64
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
Ephemeral volumes with BeeGFS CSI provisioner on Kubernetes
One of more obvious characteristics of Persistent Volumes is they persist, i.e. survive pod(s) that use them until the claim for the PV itself is deleted, as...
SolidFire Operator for Kubernetes
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
Scaling out Nomad batch jobs with BeeGFS and NetApp E-Series
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Backup and restore NetApp BeeGFS CSI PVs with Kanister
Introduction What Kanister does Summary Demo
An introduction to NetApp BeeGFS CSI
Introduction Use cases Getting started Options in a mixed environment Deploy and use BeeGFS CSI Data protection Summary Demo
Consume SolidFire storage from Proxmox hosts
Configure Proxmox 7.1 with SolidFire 12.3 SolidFire Demo VM on Proxmox
Nomad batch jobs with BeeGFS and E-Series
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Rest Server with NetApp E-Series
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
On-prem Platform9 Managed Kubernetes with SolidFire
Introduction
SolidFire capacity and efficiency report generator
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Manage SolidFire from Jupyter Python or .NET notebooks
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
HashiCorp Nomad CSI with NetApp SolidFire and E-Series back-ends
Introduction NetApp E-Series NetApp BeeGFS CSI Other CSI provisioners and non-CSI approaches NetApp SolidFire Cind...
Evaluating ONTAP S3 performance with s3tester
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
curl with native JSON support and SolidFire API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Velero V1.8 with Restic, SolidFire 12.3 and StorageGRID 11.5
NOTICE: all credentials and tokens on this page are samples, not leaked.
Check Active IQ connectivity from HCC on SolidFire mNode
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
Fix Trident's expired credentials for Kubernetes API
Today I got this error on Kubernetes v1.23.4 while trying out a Trident CLI command (tridentctl):
Kubernetes with Cinder CSI Plugin on Openstack Yoga/Xena with SolidFire 12.3 - Part 1
NOTICE: all credentials and tokens on this page are samples, not leaked.
Create and maintain SolidFire volumes and accounts with Terraform
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidFire RBAC workflow with Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
Configure SNMP on SolidFire cluster using Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
StorageGRID S3 in Public Cloud workflows without Data-at-Rest
This week I heard of a StorageGRID customer who had a query about data processing in the cloud. Probably instinctively, their first idea was to copy data to ...
SolidFire v12 Backup and Restore with Wasabi S3
It's very easy and works as you expected:
Using NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Getting started with NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Red Hat Quay with NetApp ONTAP S3
NOTICE: all credentials and tokens on this page are samples, not leaked.
Getting SolidFire volume details with Powershell and Python
Just a few examples for those who struggle to get started.
Using rclone to copy StorageGRID S3 data to local filesystem
NOTICE: all credentials and tokens on this page are samples, not leaked.
Using NetApp SolidFire Hybrid Cloud Control (HCC) API from PowerShell
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Integrate SolidFire with ServiceNow
This is speculative and I haven't tried it, but it looks very interesting.
Flatcar Container Linux with SolidFire iSCSI
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Replicate volume data from Digital Ocean to SolidFire and back
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
SolidFire highlights from NetApp INSIGHT 2021
In the case you missed NetApp INSIGHT 2021 and want to catch up with latest SolidFire developments, I recommend to consider some of the following sessions.
SGAC v0.2.1
Some two months ago I rewrote SGAC and released it as v0.1.
Red Hat Quay with NetApp StorageGRID S3 Back End
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
Using Terraform 1.0.6 with SolidFire 12.3
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Logical backup vs. storage-assisted backup with Kasten v4 and SolidFire 12
To answer the question quickly: logical backups make sense.
How to create StorageGRID object path-based ILM rule
Say you have a bucket called junk with "directory tree" (not really but…) several levels deep (junk/lev1/lev2) and want to do some ILM stuff on the stuff in ...
Copy StorageGRID objects and tags using rclone
Create two buckets, source and destination, a PUT a test object with some junk tags to source/.
SolidFire SNMP v3, Telegraf, Prometheus, Grafana
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SGAC v0.1
How it begun
GA of NetApp Trident v21.07
Latest & greatest NetApp Trident is out!
Monitor SolidFire with SNMP
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Storage account-level vs. IQN-level CHAP on SolidFire
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Improve SolidFire Support Bundle Log Generation and Upload with Automation and OneCollect
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Data Path in SolidFire clusters with Protection Domains
In the post that compares SolidFire Protection Domains with Availability Zones I had this illustration of network connectivity among SolidFire v12 cluster no...
Faster initialization and rebalancing with Dynamic Disk Pools on NetApp E-Series
RAID 6 vs DDP DDP expansion Disk media refresh with DDP pools Demo
Maximum parallelization of SolidFire Backup and Volume Copy/Clone jobs
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
SolidBackup with alternative backup clients
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
Role of SolidFire networks in SolidFire storage replication
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
Does SolidFire support Availability Zones
SolidFire Double Helix
Fetch Trident's SolidFire metrics from outside of your container environment
If I had a SolidFire array in a VM and container environment (which I do), I'd prefer to run Prometheus and Grafana in VMs, rather than cram the monitoring i...
Monitor SolidFire Network with SolidFire-Exporter, Prometheus and Grafana
In the first solidfire-exporter post I went through the first two steps required to gather SolidFire (or NetApp HCI) data and get it into Prometheus. I also ...
SolidFire Maintenance Mode
Maintenance Mode is a relatively new SolidFire feature that takes a node in and out of the neutral. In other words, it nicely moves a node's services to rema...
Mirantis Kubernetes Engine 3.4 with NetApp SolidFire 12.2
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
GA of NetApp Trident v21.04
What Upgrade procedure Before Out with the old, in with the new Verify success Trident for ARM64 and other non-AMD64 ar...
SolidFire, KVM, Duplicati and S3 Object Storage
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
Backup SolidFire volumes to S3-compatible storage
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
GA of SolidFire 12.3
Snapshot queue and serialization
NetApp SolidFire and Trident CSI failover automation with Powershell
While experimenting with SolidFire and Trident CSI failover for Kubernetes, I came across a challenge:
Testing Edge-to-DC using Photon IoT and ONTAP
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
Hardware monitoring of NetApp HCI compute nodes for dark sites
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
Kubernetes failover and failback with Trident CSI and SolidFire
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
NetApp StorageGRID for Vertica EON Mode
WTF is EON Mode What do I need to do to get Vertica EON Mode work with StorageGRID TLS certificate for HTTPS IP address for S3 API endp...
NetApp Trident v21.01.1 on Linux/ARM64 with SolidFire iSCSI storage
Intro Build \& Deploy What about s390x, ppc64le and other architectures Next steps Version info Notes on linux/s390x (Feb 25, 2021)
Use StorageGRID for private container registry
Docker Registry
Install NetApp Trident v21.01.01 with Helm v3 and configure a SolidFire back-end
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Get Rancher Kubernetes deployment log for on NetApp HCI mNode
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NetApp HCI with Cloud Backup Service
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
StorageGRID object versioning
"There's no documentation" is different from "there are no copy-paste examples".
Virtualized StorageGRID for Splunk Smartstore on NetApp HCI and EF-Series array
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Elasticsearch on NetApp HCI H615C with EF-Series EF280
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Virtualized Splunk on NetApp HCI and EF Series iSCSI storage
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
BeeGFS on NetApp HCI with EF280 for high-speed file access from Virtual Machines
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
DiskSpd performance from NetApp HCI VM to EF280
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
Adapter, network and VLAN isolation on NetApp HCI
This comes up every so often:
Protect your Kubernetes with Kasten and SolidFire
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
SolidFire PowerShell Tools, Python CLI and SDK pip packages v1.7
This is a nice Christmas present as far as I am concerned, because it's been a while since SolidFire PowerShell tools, sfcli and their respective SDKs v1.5 h...
Rancher Kubernetes Layer-7 NLB/Ingress with NGINX Plus and Let's Encrypt
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Get NetApp Hybrid Cloud Control logs via the HCC API
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
How much slower is iSCSI vs. Fibre Channel
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
Set Temporary Storage QoS Policy for SolidFire Volume
Say we have a Volume ID 321 with a storage QoS Policy ID 5, and need to run a temporary job that would benefit from a different Storage QoS Policy (higher or...
SolidFire mNode and HCC Log Fowarding
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
SolidFire Provider for Terraform
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
Dark Mode for NetApp HCI and SolidFire
NetApp HCI, SolidFire, eSDS Web UI
Deploying Rancher Worker VMs to NetApp HCI with VMware VSS
Earlier this week I spotted the advice to not select a VM host when deploying Rancher worker VMs to a vSphere environment where DRS is enabled, because "DRS ...
solid-rancher
solid-rancher is a Github repo I created to organize and enrich information related to Rancher on SolidFire (and NetApp HCI in general).
solidfire
SolidFire Extension for Windows Admin Center 2025
Introduction Walk-through And now… Conclusion Appendix A: demo Animated GIF (no playback control) Video demo with voice-over ...
SolidFire Gateway for Windows Admin Center 2025
Introduction What it is What it does IIS Setup Why this matters What about it? Conclusion
Updated Terraform provider for SolidFire
Introduction What's new in 2025 Next steps
The shocking truth about SolidFire ModifySchedule method
Introduction Show me Why? Thoughts Conclusion
Firemox - an anti-plugin for Proxmox PVE with NetApp SolidFire
Background Firemox What it does, and doesn't (Stopping) scope creep Known issues and limitations Conclusion Demo and source c...
SolidFire backup to disk with Versity S3 Gateway
This is more appropriate for a tweet, but anyway…
Do we need a NetApp SolidFire plugin for Proxmox
Who wants it and why? Perl for the win! Features Effort Appendix A: what works and how Appendix B: observations, problems, solutions Appendix ...
SFC (SolidFire Collector) 2.1
Introduction SFC 2.1 Queries Summary
Windows Server 2025 with NetApp SolidFire
I wrote about Windows Server 2025 here.
Build NetApp SolidFire MCP server
Introduction MCP Use cases? Get, set, and security Conclusion Additional reading
InfluxDB 3 Core Alpha available for testing
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
Convert NetApp HCI from VMware to Hyper-V
Requirement Workflow Storage considerations Tools
Boot OpenShift RCOS from NetApp SolidFire iSCSI target
Introduction How Other SolidFire-related tips Conclusion
Kubefire - tools and recipes for Kubernetes failover/failback with SolidFire
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
Extract SolidFire volume attributes created by Trident or other apps
This series of posts has several parts:
Increase size of SolidFire volumes paired for replication
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
Snapshots and snapshot schedules in SFC v2
Introduction
Trident QoS policy sucker for SolidFire backend
Pull QoS policy from SolidFire into Trident back-end configuration for solidfire-san Exercise care What does the IOPS really do? What does all this ...
Snapshots and snapshot schedules in NetApp SolidFire
Introduction Slightly confusing SolidFire snapshot schedules Create a schedule Group vs. single One volume, multiple schedules FIFO settings ...
SolidFire Collector v2.0.0 is ready
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Make use of storage QoS histograms on NetApp SolidFire
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Use Telegraf to send NetApp SolidFire metrics to InfluxDB
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Access NetApp SolidFire API with Async IO
Introduction
Towards next SolidFire Collector (SFC)
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Tenant (account) attributes on NetApp SolidFire
It took me a while
OpenAPI and SolidFire
SolidFire doesn't have an OpenAPI interface. See here.
Metrics for NetApp SolidFire backup-to-S3 in InfluxDB and Grafana
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
NetApp SolidFire Collector with Grafana 11
You may have heard Grafana 11 is coming out soon.
Backup NetApp SolidFire's non-Kubernetes volumes with Velero
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Two
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Three
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Use Velero with NetApp Verda and Trident CSI
What is Verda Example with Redis Conclusion
Velero v1.13 metadata, hooks with NetApp Trident v24.02
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Quickly install NetApp Trident v24.02 on ARM64 Kubernetes
Here we go again…
Ubuntu 24.04 LTS with NetApp SolidFire
Introduction Create, discover, login Efficiency - zpools on SoliFire vs global SolidFire efficiencies Comparison with XFS and BTRFS ...
Add NetApp SolidFire iSCSI storage to KVM
Introduction Storage options exposed in Virtual Manager Filesystem directory Physical disk device Preformatted block device ...
How to change NetApp HCI from VMware to alternatives
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
Kubernetes KEDA with NetApp SolidFire and E-Series
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
UNMAP/TRIM Hyper-V volumes backed by NetApp SolidFire
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
NetApp SolidFire backup to S3 and MinIO compression savings
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
RBAC and delegation for SolidFire JSON-RPC API with Lua
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
NetApp SolidFire with GenAI and inferencing workloads
Introduction Inferencing with SolidFire Examples Making use of iSCSI Share data with a parallel file system Share ...
Calculate snapshot capacity utilization on NetApp SolidFire
Introduction Clone and analyze Example with Postgres writeBytes metric Cost issue Do we still need to clone those snapshots? How to minimize s...
Velero 1.12 and CSI Snapshot Data Movement with NetApp SolidFire
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
SolidBackup with Kopia
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
Use Simple Backups to file-backup cloned SolidFire volumes to S3/B2
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
Using synthetic SolidFire S3 backups for Dev/Test purposes
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
SolidFire backup-to-S3 with Backblaze
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
Block volume mode in Kubernetes with SolidFire
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
Use SolidFire API to monitor clone and backup jobs for profit and pleasure
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
SolidFire backup-to-S3 using ONTAP S3 destination
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
StatefulSet PVC Retention with Trident and SolidFire
Introduction
What's new in NetApp Trident v23.07
Introduction
Azure Linux with SolidFire iSCSI targets
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
CloudCasa, Velero, NetApp Trident, and SolidFire
Table of Contents
Using snapshot attributes in SolidFire
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
GA of SolidFire 12.7
SolidFire and eSDS (containerized SolidFire for 3rd party x86 servers) version 12.7 was released in late October, but I haven't blogged about it.
Hybrid cloud scenarios with Cloudflare serverless
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
End of Availability for SolidFire
This week NetApp released product communique CPC-00467 (NetApp support portal login required) on end of availability of SolidFire.
SolidFire Backup to S3 over Storage Network
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
Rocky Linux 8 and 9 with NetApp Trident Docker volume plugin and SolidFire 12 iSCSI storage
The official Trident documentation is okay, but it mentions no Rocky Linux.
Display per-storage node performance guarantees of SolidFire nodes
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
XCP-ng and XOA with NetApp SolidFire iSCSI Storage Repositories
Introduction XCP-NG with SolidFire XOA Conclusion
Cassandra with SolidFire and E-Series
Introduction
Storage efficiency with Kafka 3.2 and NetApp SolidFire 12
Objective How I tested Kafka tests and results Random ASCII records StorageGRID audit log Protecting Kafka on a single site...
The new Kasten K10 v5.0 with NetApp SolidFire
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
GA of SolidFire 12.5
SolidFire and eSDS (containerized SolidFire for 3rd party x86 servers) version 12.5 just came out.
SolidFire Backup to S3 with Object Lock
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
SolidFire Collector on Kubernetes
What is SFC Making SolidFire Collector work with Kubernetes Appendix: Deploymennt for SFC and Graphite
Ephemeral volumes with BeeGFS CSI provisioner on Kubernetes
One of more obvious characteristics of Persistent Volumes is they persist, i.e. survive pod(s) that use them until the claim for the PV itself is deleted, as...
SolidFire Operator for Kubernetes
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
Consume SolidFire storage from Proxmox hosts
Configure Proxmox 7.1 with SolidFire 12.3 SolidFire Demo VM on Proxmox
On-prem Platform9 Managed Kubernetes with SolidFire
Introduction
SolidFire capacity and efficiency report generator
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
HashiCorp Nomad with NetApp SolidFire-backed iSCSI volumes
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
curl with native JSON support and SolidFire API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Velero V1.8 with Restic, SolidFire 12.3 and StorageGRID 11.5
NOTICE: all credentials and tokens on this page are samples, not leaked.
Check Active IQ connectivity from HCC on SolidFire mNode
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
Kubernetes with Cinder CSI Plugin on Openstack Yoga/Xena with SolidFire 12.3 - Part 1
NOTICE: all credentials and tokens on this page are samples, not leaked.
Create and maintain SolidFire volumes and accounts with Terraform
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidFire RBAC workflow with Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
Configure SNMP on SolidFire cluster using Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidFire v12 Backup and Restore with Wasabi S3
It's very easy and works as you expected:
Getting SolidFire volume details with Powershell and Python
Just a few examples for those who struggle to get started.
Using NetApp SolidFire Hybrid Cloud Control (HCC) API from PowerShell
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Integrate SolidFire with ServiceNow
This is speculative and I haven't tried it, but it looks very interesting.
Flatcar Container Linux with SolidFire iSCSI
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Replicate volume data from Digital Ocean to SolidFire and back
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
SolidFire highlights from NetApp INSIGHT 2021
In the case you missed NetApp INSIGHT 2021 and want to catch up with latest SolidFire developments, I recommend to consider some of the following sessions.
Using Terraform 1.0.6 with SolidFire 12.3
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Logical backup vs. storage-assisted backup with Kasten v4 and SolidFire 12
To answer the question quickly: logical backups make sense.
SolidFire SNMP v3, Telegraf, Prometheus, Grafana
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Monitor SolidFire with SNMP
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Storage account-level vs. IQN-level CHAP on SolidFire
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Improve SolidFire Support Bundle Log Generation and Upload with Automation and OneCollect
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Data Path in SolidFire clusters with Protection Domains
In the post that compares SolidFire Protection Domains with Availability Zones I had this illustration of network connectivity among SolidFire v12 cluster no...
Maximum parallelization of SolidFire Backup and Volume Copy/Clone jobs
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
SolidBackup with alternative backup clients
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
Role of SolidFire networks in SolidFire storage replication
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
Does SolidFire support Availability Zones
SolidFire Double Helix
Fetch Trident's SolidFire metrics from outside of your container environment
If I had a SolidFire array in a VM and container environment (which I do), I'd prefer to run Prometheus and Grafana in VMs, rather than cram the monitoring i...
Monitor SolidFire Network with SolidFire-Exporter, Prometheus and Grafana
In the first solidfire-exporter post I went through the first two steps required to gather SolidFire (or NetApp HCI) data and get it into Prometheus. I also ...
SolidFire Maintenance Mode
Maintenance Mode is a relatively new SolidFire feature that takes a node in and out of the neutral. In other words, it nicely moves a node's services to rema...
Mirantis Kubernetes Engine 3.4 with NetApp SolidFire 12.2
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire, KVM, Duplicati and S3 Object Storage
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
Backup SolidFire volumes to S3-compatible storage
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
GA of SolidFire 12.3
Snapshot queue and serialization
NetApp SolidFire and Trident CSI failover automation with Powershell
While experimenting with SolidFire and Trident CSI failover for Kubernetes, I came across a challenge:
Hardware monitoring of NetApp HCI compute nodes for dark sites
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
Kubernetes failover and failback with Trident CSI and SolidFire
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
Get started with solidfire-exporter
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Announcing HCICollector v0.7
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
NetApp Trident v21.01.1 on Linux/ARM64 with SolidFire iSCSI storage
Intro Build \& Deploy What about s390x, ppc64le and other architectures Next steps Version info Notes on linux/s390x (Feb 25, 2021)
Kubernetes data protection and storage management with NetApp SolidFire and Kasten K10
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Install NetApp Trident v21.01.01 with Helm v3 and configure a SolidFire back-end
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Virtualized Splunk on NetApp HCI and EF Series iSCSI storage
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
BeeGFS on NetApp HCI with EF280 for high-speed file access from Virtual Machines
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
DiskSpd performance from NetApp HCI VM to EF280
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
Adapter, network and VLAN isolation on NetApp HCI
This comes up every so often:
Protect your Kubernetes with Kasten and SolidFire
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
SolidFire PowerShell Tools, Python CLI and SDK pip packages v1.7
This is a nice Christmas present as far as I am concerned, because it's been a while since SolidFire PowerShell tools, sfcli and their respective SDKs v1.5 h...
Rancher Kubernetes Layer-7 NLB/Ingress with NGINX Plus and Let's Encrypt
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Get NetApp Hybrid Cloud Control logs via the HCC API
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
Set Temporary Storage QoS Policy for SolidFire Volume
Say we have a Volume ID 321 with a storage QoS Policy ID 5, and need to run a temporary job that would benefit from a different Storage QoS Policy (higher or...
SolidFire mNode and HCC Log Fowarding
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
SolidFire Provider for Terraform
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
Helpful waste of time
Introduction Update 1 (2023/08/30) Update 2 (2025/05/03) Update 3 (2025/06/07) FAQs
Dark Mode for NetApp HCI and SolidFire
NetApp HCI, SolidFire, eSDS Web UI
Deploying Rancher Worker VMs to NetApp HCI with VMware VSS
Earlier this week I spotted the advice to not select a VM host when deploying Rancher worker VMs to a vSphere environment where DRS is enabled, because "DRS ...
solid-rancher
solid-rancher is a Github repo I created to organize and enrich information related to Rancher on SolidFire (and NetApp HCI in general).
eseries
Data pipeline with BeeGFS FS Event Notifications and Versity S3 Gateway
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Improved pipelines with BeeGFS FS Event Notifications in v8
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
Cloudera Base with NetApp E-Series
Introduction Reference architectures High-level design and best practices What's new in Cloudera Base Deployment topology Sizin...
InfluxDB 3 Core Alpha available for testing
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
MinIO and Versity S3 GW with tiny object workloads on NetApp E-Series
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
Using NetApp E-Series Volume Copy
What is a volume created by Volume Copy operation How does it work? Progress Reserve size Reserve location Priority Automating Volume Copy A...
EConfig v2
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
NetApp E-Series with containerized BeeGFS, NFS, S3
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
SSD Cache feature on NetApp SANtricity E-Series
WTH is "SSD Cache" Create SSD cache Configure HDD-based volumes to use SSD Cache Summary API for monitoring
NetApp SANtricity PowerShell module for E-Series
Get NetApp.SANtricity module for PowerShell 5.1 Install and load Use End Appendix A - Known issues \& workarounds
ZFS with NetApp E-Series
Introduction What is E-Series anyway Easy storage management Conclusion
ZFS deduplication with NetApp E-Series
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
NetApp E-Series DAS or SAN storage as Veeam Hardened Repository
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
Kubernetes KEDA with NetApp SolidFire and E-Series
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
PyTorch checkpointing workload with NetApp E-Series
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
Containerized BeeGFS with NetApp E-Series
Introduction
NetApp E-Series sizing for Splunk 9 with SmartStore
Introduction Existing material Related posts on this blog Observations TB per day Events per day Sizing challenges ...
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Monitor Snapshot Consistency Groups of NetApp E-Series SANtricity OS
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Faster PostgreSQL with DDP-based RAID 1 compared to DDP-based RAID 6
Introduction Environment Tests Results Other performance views Conclusion
Monitor snapshot and clone repositories of NetApp E-Series SANtricity OS
Problem statement Considerations First iteration Second iteration Conclusion
Benefits of RAID 1 in E-Series DDP
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
Stand-alone and Consistency Group snapshots on NetApp E-Series
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Monitoring NetApp E-Series with PRTG
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Ubuntu 22.04 LTS as iSER client to NetApp E-Series
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
Versity S3 Gateway with BeeGFS
What Config How Using Conclusion Appendix - External performance test
Event monitoring with SNMP trap notifications from NetApp E-Series arrays
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
MinIO Erasure Coding with NetApp E-Series
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
Storage considerations for Memphis message broker
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
Versity S3 Gateway
What
Use cases for AWS mountpoint-s3 with NetApp E-Series and SolidFire
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Elasticsearch performance with E-Series
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Visualize E-Series temperature and power consumption metrics with EPA
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Backup/restore E-Series Performance Analyzer with Kasten K10
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Store Kasten backups on NetApp E-Series
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
Flash media overprovisioning on NetApp E-Series
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
Burst on-prem GPU workloads from BeeGFS/E-Series clusters to Spot Ocean for Spark in the cloud
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
Monitor wear level of NetApp E-Series flash drives via the API and from the CLI
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
SSD disk wear indicator in E-Series SANtricity 11.70
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
NetApp BeeGFS CSI driver 1.4.0
This week NetApp released BeeGFS CSI driver v1.4.0 which adds support for newer Kubernetes and BeeGFS.
Gathering and forwarding E-Series SANtricity Major Event Log (MEL)
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
Prometheus exporter for NetApp E-Series SANtricity OS
NetApp E-Series Prometheus Exporter
Forward E-Series SANtricity logs to remote syslog server
Configure SANtricity to send array events to a remote syslog server
E-Series in a Kubernetes environment with DirectPV, TopoLVM, CSI Driver LVM CSI drivers
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
PowerShell password change script for local user account on E-Series SANtricity OS
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
Notes on NetApp E-Series Performance Analyzer
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
Rocky Linux 8 and 9 added to NetApp E-Series interoperability matrix
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
Notes on MinIO performance with NetApp E-Series
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
iRODS or Robinhood HSM with BeeGFS
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
Speed of volume creation with BeeGFS CSI
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
Low-hanging BeeGFS efficiency fruit
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
TensorStore with BeeGFS
TensorStore is a new C++ and Python library that provides a uniform API for reading and writing n-dimensional data.
DDP capacity splitter for E-Series
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
New Dynamic Disk Pool configuration and E-Series SANtricity
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
Brute force sizing NetApp E-Series
Introduction Considerations Create configuration options Choice of query tool Show available options Query capacity range Manual selection of ...
LXD containers and VMs on BeeGFS with NetApp E-Series
Introduction Why LXD on BeeGFS (with or without NetApp E-Series) Get started Optimal BeeGFS settings HA BeeGFS client in LXD VMs on LXD server a...
Configuration approaches to NetApp E-Series with ThinkParQ BeeGFS
It may not be easy to digest how BeeGFS with NetApp E-Series is usually configured.
Send BeeGFS and NetApp E-Series performance metrics to InfluxDB v2 or scrape them form Prometheus
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad pack for InfluxDB with BeeGFS filesystem
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
Leverage BeeGFS in Nextflow to avoid unnecessary data movement
Nextflow configuration and environment variables allow us to make use of BeeGFS with E-Series for most demanding IO tasks.
Simple S3 service endpoint for BeeGFS using Hashicorp Nomad and stand-alone MinIO
I have a small Nomad cluster which can access a BeeGFS filesystem.
Simple S3 service endpoint for BeeGFS using Hashicorp Nomad and stand-alone MinIO
I have a small Nomad cluster which can access a BeeGFS filesystem.
Apptainer with BeeGFS
Apptainer is based on the Singularity project.
Cassandra with SolidFire and E-Series
Introduction
Apache Ozone S3 and NetApp E-Series
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
E-Series as Tier One for multi-tiered Kafka clusters
Multi-tiered storage in Kafka clusters How to leverage E-Series Performance vs. data protection overhead Sequential performance vs. lat...
Apache Hadoop 3 with NetApp E-Series
HDFS Durability and External Protected Storage Does everyone need RF2 HDFS Erasure Coding Compression NFS gateway Snapsho...
Copy files to/from BeeGFS before or after scheduled jobs
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
Kubernetes with vSphere CSI Plugin and NetApp E-Series
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
BeeGFS and BeeGFS CSI on ARM64
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
Scaling out Nomad batch jobs with BeeGFS and NetApp E-Series
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Backup and restore NetApp BeeGFS CSI PVs with Kanister
Introduction What Kanister does Summary Demo
An introduction to NetApp BeeGFS CSI
Introduction Use cases Getting started Options in a mixed environment Deploy and use BeeGFS CSI Data protection Summary Demo
Nomad batch jobs with BeeGFS and E-Series
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Rest Server with NetApp E-Series
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
Faster initialization and rebalancing with Dynamic Disk Pools on NetApp E-Series
RAID 6 vs DDP DDP expansion Disk media refresh with DDP pools Demo
Virtualized StorageGRID for Splunk Smartstore on NetApp HCI and EF-Series array
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Elasticsearch on NetApp HCI H615C with EF-Series EF280
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Virtualized Splunk on NetApp HCI and EF Series iSCSI storage
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
BeeGFS on NetApp HCI with EF280 for high-speed file access from Virtual Machines
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
DiskSpd performance from NetApp HCI VM to EF280
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
How much slower is iSCSI vs. Fibre Channel
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
e-series
E-Series Performance Analyzer (EPA) v4 beta
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
OPEA AI with NetApp E-Series
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Swagger files for NetApp E-Series
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
EConfig v2
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
NetApp E-Series with containerized BeeGFS, NFS, S3
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
SSD Cache feature on NetApp SANtricity E-Series
WTH is "SSD Cache" Create SSD cache Configure HDD-based volumes to use SSD Cache Summary API for monitoring
NetApp SANtricity PowerShell module for E-Series
Get NetApp.SANtricity module for PowerShell 5.1 Install and load Use End Appendix A - Known issues \& workarounds
Monitor progress and notify of E-Series media scan events
Introduction SANtricity API methods related to scrubbing, scanning, fixing data issues Media scan in Web UI Relevant API methods Implementation ...
NetApp E-Series DAS or SAN storage as Veeam Hardened Repository
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
Kubernetes KEDA with NetApp SolidFire and E-Series
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Containerized BeeGFS with NetApp E-Series
Introduction
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
NetApp E-Series sizing for Splunk 9 with SmartStore
Introduction Existing material Related posts on this blog Observations TB per day Events per day Sizing challenges ...
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Monitor Snapshot Consistency Groups of NetApp E-Series SANtricity OS
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Faster PostgreSQL with DDP-based RAID 1 compared to DDP-based RAID 6
Introduction Environment Tests Results Other performance views Conclusion
Monitor snapshot and clone repositories of NetApp E-Series SANtricity OS
Problem statement Considerations First iteration Second iteration Conclusion
Benefits of RAID 1 in E-Series DDP
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
Stand-alone and Consistency Group snapshots on NetApp E-Series
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Monitoring NetApp E-Series with PRTG
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Ubuntu 22.04 LTS as iSER client to NetApp E-Series
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
Versity S3 Gateway with BeeGFS
What Config How Using Conclusion Appendix - External performance test
Event monitoring with SNMP trap notifications from NetApp E-Series arrays
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
ThinkParQ takes over NetApp-created BeeGFS CSI driver
I've written several posts about NetApp's BeeGFS CSI driver.
MinIO Erasure Coding with NetApp E-Series
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
Storage considerations for Memphis message broker
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
Versity S3 Gateway
What
Flash media overprovisioning on NetApp E-Series
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
Burst on-prem GPU workloads from BeeGFS/E-Series clusters to Spot Ocean for Spark in the cloud
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
Monitor wear level of NetApp E-Series flash drives via the API and from the CLI
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
SSD disk wear indicator in E-Series SANtricity 11.70
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
NetApp BeeGFS CSI driver 1.4.0
This week NetApp released BeeGFS CSI driver v1.4.0 which adds support for newer Kubernetes and BeeGFS.
Gathering and forwarding E-Series SANtricity Major Event Log (MEL)
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
Prometheus exporter for NetApp E-Series SANtricity OS
NetApp E-Series Prometheus Exporter
Forward E-Series SANtricity logs to remote syslog server
Configure SANtricity to send array events to a remote syslog server
E-Series in a Kubernetes environment with DirectPV, TopoLVM, CSI Driver LVM CSI drivers
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
PowerShell password change script for local user account on E-Series SANtricity OS
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
Notes on NetApp E-Series Performance Analyzer
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
Rocky Linux 8 and 9 added to NetApp E-Series interoperability matrix
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
Notes on MinIO performance with NetApp E-Series
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
iRODS or Robinhood HSM with BeeGFS
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
Speed of volume creation with BeeGFS CSI
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
Low-hanging BeeGFS efficiency fruit
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
TensorStore with BeeGFS
TensorStore is a new C++ and Python library that provides a uniform API for reading and writing n-dimensional data.
DDP capacity splitter for E-Series
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
New Dynamic Disk Pool configuration and E-Series SANtricity
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
Brute force sizing NetApp E-Series
Introduction Considerations Create configuration options Choice of query tool Show available options Query capacity range Manual selection of ...
LXD containers and VMs on BeeGFS with NetApp E-Series
Introduction Why LXD on BeeGFS (with or without NetApp E-Series) Get started Optimal BeeGFS settings HA BeeGFS client in LXD VMs on LXD server a...
Configuration approaches to NetApp E-Series with ThinkParQ BeeGFS
It may not be easy to digest how BeeGFS with NetApp E-Series is usually configured.
Send BeeGFS and NetApp E-Series performance metrics to InfluxDB v2 or scrape them form Prometheus
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad pack for InfluxDB with BeeGFS filesystem
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
Simple S3 service endpoint for BeeGFS using Hashicorp Nomad and stand-alone MinIO
I have a small Nomad cluster which can access a BeeGFS filesystem.
Apptainer with BeeGFS
Apptainer is based on the Singularity project.
Cassandra with SolidFire and E-Series
Introduction
Apache Ozone S3 and NetApp E-Series
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
Storage efficiency with Kafka 3.2 and NetApp SolidFire 12
Objective How I tested Kafka tests and results Random ASCII records StorageGRID audit log Protecting Kafka on a single site...
E-Series as Tier One for multi-tiered Kafka clusters
Multi-tiered storage in Kafka clusters How to leverage E-Series Performance vs. data protection overhead Sequential performance vs. lat...
Apache Hadoop 3 with NetApp E-Series
HDFS Durability and External Protected Storage Does everyone need RF2 HDFS Erasure Coding Compression NFS gateway Snapsho...
Copy files to/from BeeGFS before or after scheduled jobs
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
Kubernetes with vSphere CSI Plugin and NetApp E-Series
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
BeeGFS and BeeGFS CSI on ARM64
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
Scaling out Nomad batch jobs with BeeGFS and NetApp E-Series
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Backup and restore NetApp BeeGFS CSI PVs with Kanister
Introduction What Kanister does Summary Demo
An introduction to NetApp BeeGFS CSI
Introduction Use cases Getting started Options in a mixed environment Deploy and use BeeGFS CSI Data protection Summary Demo
Nomad batch jobs with BeeGFS and E-Series
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Rest Server with NetApp E-Series
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
HashiCorp Nomad CSI with NetApp SolidFire and E-Series back-ends
Introduction NetApp E-Series NetApp BeeGFS CSI Other CSI provisioners and non-CSI approaches NetApp SolidFire Cind...
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
Faster initialization and rebalancing with Dynamic Disk Pools on NetApp E-Series
RAID 6 vs DDP DDP expansion Disk media refresh with DDP pools Demo
Virtualized StorageGRID for Splunk Smartstore on NetApp HCI and EF-Series array
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Elasticsearch on NetApp HCI H615C with EF-Series EF280
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
Virtualized Splunk on NetApp HCI and EF Series iSCSI storage
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
BeeGFS on NetApp HCI with EF280 for high-speed file access from Virtual Machines
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
DiskSpd performance from NetApp HCI VM to EF280
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
How much slower is iSCSI vs. Fibre Channel
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
s3
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 vector search - DIY vs AWS S3 Vectors
This is a two-part post:
SolidFire backup to disk with Versity S3 Gateway
This is more appropriate for a tweet, but anyway…
Data pipeline with BeeGFS FS Event Notifications and Versity S3 Gateway
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Improved pipelines with BeeGFS FS Event Notifications in v8
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
What is MinIO up to these days?
"Adjustments" Latest and greatest: "breaking changes" Are you telling me there's a chance? Thoughts Risk and commercial ...
Cloudera Base with NetApp E-Series
Introduction Reference architectures High-level design and best practices What's new in Cloudera Base Deployment topology Sizin...
MinIO and Versity S3 GW with tiny object workloads on NetApp E-Series
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
Velero AWS Plugin and SignatureDoesNotMatch nonsense
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Metrics for NetApp SolidFire backup-to-S3 in InfluxDB and Grafana
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
Backup NetApp SolidFire's non-Kubernetes volumes with Velero
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
NetApp StorageGRID networks
Introduction
Filesystem block size used by NetApp StorageGRID
So, what filesystem block size does StorageGRID 11.8 use?
Analyze HTTP logs from NetApp StorageGRID gateway nodes
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Delete old object versions on NetApp StorageGRID
Introduction
NetApp StorageGRID on VMware
Introduction Network Servers StorageGRID load balancer OS Storage Flash tier NL-SAS tier DDP vs RAID Gro...
Scan NetApp StorageGRID S3 buckets for viruses and malware
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Versity S3 Gateway with BeeGFS
What Config How Using Conclusion Appendix - External performance test
SolidBackup with Kopia
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
Use Simple Backups to file-backup cloned SolidFire volumes to S3/B2
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
MinIO Erasure Coding with NetApp E-Series
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
Using synthetic SolidFire S3 backups for Dev/Test purposes
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
SolidFire backup-to-S3 with Backblaze
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
SolidFire backup-to-S3 with Backblaze
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
Teradata Vantage with NetApp S3 object stores
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
Storage considerations for Memphis message broker
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
Microsoft SQL Server data virtualization PolyBase with S3 Object Stores
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
SolidFire backup-to-S3 using ONTAP S3 destination
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
Use ONTAP S3 as backup destination for Velero
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
StorageGRID and Elasticsearches
Why "Elasticsearches"?
Versity S3 Gateway
What
Notes on MinIO performance with NetApp E-Series
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
SolidFire Backup to S3 over Storage Network
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
SolidFire Backup to S3 over Storage Network
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
Simple S3 service endpoint for BeeGFS using Hashicorp Nomad and stand-alone MinIO
I have a small Nomad cluster which can access a BeeGFS filesystem.
Apache Ozone S3 and NetApp E-Series
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
SolidFire Backup to S3 with Object Lock
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
Evaluating ONTAP S3 performance with s3tester
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
Velero V1.8 with Restic, SolidFire 12.3 and StorageGRID 11.5
NOTICE: all credentials and tokens on this page are samples, not leaked.
S3 Select vs. remote SQL access to CSV over FUSE
In a recent post I wrote about S3 Select in StorageGRID 11.6.
StorageGRID S3 in Public Cloud workflows without Data-at-Rest
This week I heard of a StorageGRID customer who had a query about data processing in the cloud. Probably instinctively, their first idea was to copy data to ...
SolidFire v12 Backup and Restore with Wasabi S3
It's very easy and works as you expected:
Red Hat Quay with NetApp ONTAP S3
NOTICE: all credentials and tokens on this page are samples, not leaked.
SGAC v0.2.1
Some two months ago I rewrote SGAC and released it as v0.1.
Red Hat Quay with NetApp StorageGRID S3 Back End
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
How to create StorageGRID object path-based ILM rule
Say you have a bucket called junk with "directory tree" (not really but…) several levels deep (junk/lev1/lev2) and want to do some ILM stuff on the stuff in ...
Copy StorageGRID objects and tags using rclone
Create two buckets, source and destination, a PUT a test object with some junk tags to source/.
SGAC v0.1
How it begun
SolidBackup with alternative backup clients
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
SolidFire, KVM, Duplicati and S3 Object Storage
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
Backup SolidFire volumes to S3-compatible storage
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NetApp StorageGRID for Vertica EON Mode
WTF is EON Mode What do I need to do to get Vertica EON Mode work with StorageGRID TLS certificate for HTTPS IP address for S3 API endp...
Use StorageGRID for private container registry
Docker Registry
Kubernetes data protection and storage management with NetApp SolidFire and Kasten K10
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
StorageGRID as Cloud Storage (S3) Provider for Kasten K10
Previously I blogged about using Kasten with NetApp HCI and SolidFire, but I did not have time to examine another NetApp storage integration, namely that of ...
Backup Rancher cluster configuration to NetApp StorageGRID
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
StorageGRID object versioning
"There's no documentation" is different from "there are no copy-paste examples".
backup
SolidFire backup to disk with Versity S3 Gateway
This is more appropriate for a tweet, but anyway…
Velero AWS Plugin and SignatureDoesNotMatch nonsense
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Metrics for NetApp SolidFire backup-to-S3 in InfluxDB and Grafana
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
Backup NetApp SolidFire's non-Kubernetes volumes with Velero
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
Use Velero with NetApp Verda and Trident CSI
What is Verda Example with Redis Conclusion
Velero v1.13 metadata, hooks with NetApp Trident v24.02
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
NetApp E-Series DAS or SAN storage as Veeam Hardened Repository
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
NetApp SolidFire backup to S3 and MinIO compression savings
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Velero 1.12 and CSI Snapshot Data Movement with NetApp SolidFire
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
SolidBackup with Kopia
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
Use Simple Backups to file-backup cloned SolidFire volumes to S3/B2
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
SolidFire backup-to-S3 with Backblaze
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
Use SolidFire API to monitor clone and backup jobs for profit and pleasure
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Microsoft SQL Server data virtualization PolyBase with S3 Object Stores
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
SolidFire backup-to-S3 using ONTAP S3 destination
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
Use ONTAP S3 as backup destination for Velero
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
CloudCasa, Velero, NetApp Trident, and SolidFire
Table of Contents
Using snapshot attributes in SolidFire
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
Use cases for AWS mountpoint-s3 with NetApp E-Series and SolidFire
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Protect multi-volume Kubernetes applications with NetApp Trident and SolidFire
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
Velero 1.10 with NetApp Trident and SolidFire
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Backup and replicate Kubernetes PVs with SolidFire using VolSync
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Backup/restore E-Series Performance Analyzer with Kasten K10
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Store Kasten backups on NetApp E-Series
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
SolidFire Backup to S3 over Storage Network
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
The new Kasten K10 v5.0 with NetApp SolidFire
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
SolidFire Backup to S3 with Object Lock
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
Rest Server with NetApp E-Series
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
Velero V1.8 with Restic, SolidFire 12.3 and StorageGRID 11.5
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidFire v12 Backup and Restore with Wasabi S3
It's very easy and works as you expected:
Logical backup vs. storage-assisted backup with Kasten v4 and SolidFire 12
To answer the question quickly: logical backups make sense.
Maximum parallelization of SolidFire Backup and Volume Copy/Clone jobs
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
SolidBackup with alternative backup clients
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
SolidFire, KVM, Duplicati and S3 Object Storage
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
Backup SolidFire volumes to S3-compatible storage
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Kubernetes data protection and storage management with NetApp SolidFire and Kasten K10
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
StorageGRID as Cloud Storage (S3) Provider for Kasten K10
Previously I blogged about using Kasten with NetApp HCI and SolidFire, but I did not have time to examine another NetApp storage integration, namely that of ...
Backup Rancher cluster configuration to NetApp StorageGRID
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Protect your Kubernetes with Kasten and SolidFire
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
api
The shocking truth about SolidFire ModifySchedule method
Introduction Show me Why? Thoughts Conclusion
Extract SolidFire volume attributes created by Trident or other apps
This series of posts has several parts:
Increase size of SolidFire volumes paired for replication
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
Trident QoS policy sucker for SolidFire backend
Pull QoS policy from SolidFire into Trident back-end configuration for solidfire-san Exercise care What does the IOPS really do? What does all this ...
Snapshots and snapshot schedules in NetApp SolidFire
Introduction Slightly confusing SolidFire snapshot schedules Create a schedule Group vs. single One volume, multiple schedules FIFO settings ...
SFC v2 adds volume replication monitoring
What replication monitoring? What does that mean? What can we see? Other implementation details Grafana aside Summary
Monitoring volume replication in NetApp SolidFire
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
Project Longhorny
Introduction What exactly does Longhorny do? Longhorny walk-through Site-level actions Conclusion Demo
Kubernetes, Trident and SolidFire configuration - part 2
Introduction Use cases Feed Trident volume list to Velero Create backup-to-S3 jobs on SolidFire Set up cross-site replication for...
Kubernetes, Trident and SolidFire configuration visibility
Introduction Mapping applications to Kubernetes PVCs with kubectl Mapping PVCs to storage with tridentctl Mapping Trident to SolidFire with scripts ...
SolidFire Collector v2.0.0 is ready
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Access NetApp SolidFire API with Async IO
Introduction
Tenant (account) attributes on NetApp SolidFire
It took me a while
RBAC and delegation for SolidFire JSON-RPC API with Lua
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
Calculate snapshot capacity utilization on NetApp SolidFire
Introduction Clone and analyze Example with Postgres writeBytes metric Cost issue Do we still need to clone those snapshots? How to minimize s...
Stand-alone and Consistency Group snapshots on NetApp E-Series
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Use SolidFire API to monitor clone and backup jobs for profit and pleasure
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Using snapshot attributes in SolidFire
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
PowerShell password change script for local user account on E-Series SANtricity OS
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
E-Series SANtricity API with JWT aka Bearer Tokens
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
New Dynamic Disk Pool configuration and E-Series SANtricity
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
Display per-storage node performance guarantees of SolidFire nodes
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
Trident CSI REST API
Why access Trident API Controller routes Trident resources Expose the Trident REST API Examples What about it Appendix: List of Trident Resour...
SolidFire Operator for Kubernetes
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
Manage SolidFire from Jupyter Python or .NET notebooks
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
curl with native JSON support and SolidFire API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Fix Trident's expired credentials for Kubernetes API
Today I got this error on Kubernetes v1.23.4 while trying out a Trident CLI command (tridentctl):
SolidFire RBAC workflow with Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
Configure SNMP on SolidFire cluster using Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
Using NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Getting started with NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Getting SolidFire volume details with Powershell and Python
Just a few examples for those who struggle to get started.
SolidFire Maintenance Mode
Maintenance Mode is a relatively new SolidFire feature that takes a node in and out of the neutral. In other words, it nicely moves a node's services to rema...
Backup SolidFire volumes to S3-compatible storage
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Get started with solidfire-exporter
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Announcing HCICollector v0.7
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
StorageGRID object versioning
"There's no documentation" is different from "there are no copy-paste examples".
Get NetApp Hybrid Cloud Control logs via the HCC API
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
monitoring
E-Series Performance Analyzer (EPA) v4 beta
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
SFC (SolidFire Collector) 2.1
Introduction SFC 2.1 Queries Summary
InfluxDB 3 Core Alpha available for testing
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
SolidFire Collector v2.0.0 is ready
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Make use of storage QoS histograms on NetApp SolidFire
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Use Telegraf to send NetApp SolidFire metrics to InfluxDB
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Towards next SolidFire Collector (SFC)
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Towards next SolidFire Collector (SFC)
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Metrics for NetApp SolidFire backup-to-S3 in InfluxDB and Grafana
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
NetApp SolidFire Collector with Grafana 11
You may have heard Grafana 11 is coming out soon.
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Monitor Snapshot Consistency Groups of NetApp E-Series SANtricity OS
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Monitor snapshot and clone repositories of NetApp E-Series SANtricity OS
Problem statement Considerations First iteration Second iteration Conclusion
Event monitoring with SNMP trap notifications from NetApp E-Series arrays
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
Elasticsearch performance with E-Series
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Visualize E-Series temperature and power consumption metrics with EPA
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Visualize E-Series temperature and power consumption metrics with EPA
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Use Cloud Sync API and Elasticsearch to improve data replication
Why and when automate Cloud Sync?
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
Monitor wear level of NetApp E-Series flash drives via the API and from the CLI
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
SSD disk wear indicator in E-Series SANtricity 11.70
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
Gathering and forwarding E-Series SANtricity Major Event Log (MEL)
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
Prometheus exporter for NetApp E-Series SANtricity OS
NetApp E-Series Prometheus Exporter
Notes on NetApp E-Series Performance Analyzer
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
Send BeeGFS and NetApp E-Series performance metrics to InfluxDB v2 or scrape them form Prometheus
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad pack for InfluxDB with BeeGFS filesystem
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
SolidFire Collector on Kubernetes
What is SFC Making SolidFire Collector work with Kubernetes Appendix: Deploymennt for SFC and Graphite
SolidFire RBAC workflow with Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
Configure SNMP on SolidFire cluster using Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidFire SNMP v3, Telegraf, Prometheus, Grafana
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Monitor SolidFire with SNMP
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Monitor SolidFire Network with SolidFire-Exporter, Prometheus and Grafana
In the first solidfire-exporter post I went through the first two steps required to gather SolidFire (or NetApp HCI) data and get it into Prometheus. I also ...
Hardware monitoring of NetApp HCI compute nodes for dark sites
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
Get started with solidfire-exporter
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Announcing HCICollector v0.7
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
Virtualized StorageGRID for Splunk Smartstore on NetApp HCI and EF-Series array
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Elasticsearch on NetApp HCI H615C with EF-Series EF280
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
trident
Kubefire - tools and recipes for Kubernetes failover/failback with SolidFire
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
Extract SolidFire volume attributes created by Trident or other apps
This series of posts has several parts:
Backup NetApp SolidFire's non-Kubernetes volumes with Velero
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
Use Velero with NetApp Verda and Trident CSI
What is Verda Example with Redis Conclusion
Velero v1.13 metadata, hooks with NetApp Trident v24.02
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Quickly install NetApp Trident v24.02 on ARM64 Kubernetes
Here we go again…
Kubernetes KEDA with NetApp SolidFire and E-Series
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Block volume mode in Kubernetes with SolidFire
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
StatefulSet PVC Retention with Trident and SolidFire
Introduction
What's new in NetApp Trident v23.07
Introduction
CloudCasa, Velero, NetApp Trident, and SolidFire
Table of Contents
Protect multi-volume Kubernetes applications with NetApp Trident and SolidFire
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
Velero 1.10 with NetApp Trident and SolidFire
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
NetApp Trident v22.07.0 for ARM64
I had thought the posts I wrote about Trident on ARM64 were enough to get almost everyone going, but it seems it's not hard to get stuck.
Rocky Linux 8 and 9 with NetApp Trident Docker volume plugin and SolidFire 12 iSCSI storage
The official Trident documentation is okay, but it mentions no Rocky Linux.
The new Kasten K10 v5.0 with NetApp SolidFire
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
Trident CSI REST API
Why access Trident API Controller routes Trident resources Expose the Trident REST API Examples What about it Appendix: List of Trident Resour...
Ephemeral volumes with BeeGFS CSI provisioner on Kubernetes
One of more obvious characteristics of Persistent Volumes is they persist, i.e. survive pod(s) that use them until the claim for the PV itself is deleted, as...
On-prem Platform9 Managed Kubernetes with SolidFire
Introduction
HashiCorp Nomad CSI with NetApp SolidFire and E-Series back-ends
Introduction NetApp E-Series NetApp BeeGFS CSI Other CSI provisioners and non-CSI approaches NetApp SolidFire Cind...
HashiCorp Nomad with NetApp SolidFire-backed iSCSI volumes
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
Fix Trident's expired credentials for Kubernetes API
Today I got this error on Kubernetes v1.23.4 while trying out a Trident CLI command (tridentctl):
Logical backup vs. storage-assisted backup with Kasten v4 and SolidFire 12
To answer the question quickly: logical backups make sense.
GA of NetApp Trident v21.07
Latest & greatest NetApp Trident is out!
Fetch Trident's SolidFire metrics from outside of your container environment
If I had a SolidFire array in a VM and container environment (which I do), I'd prefer to run Prometheus and Grafana in VMs, rather than cram the monitoring i...
Mirantis Kubernetes Engine 3.4 with NetApp SolidFire 12.2
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
GA of NetApp Trident v21.04
What Upgrade procedure Before Out with the old, in with the new Verify success Trident for ARM64 and other non-AMD64 ar...
NetApp SolidFire and Trident CSI failover automation with Powershell
While experimenting with SolidFire and Trident CSI failover for Kubernetes, I came across a challenge:
Testing Edge-to-DC using Photon IoT and ONTAP
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
Kubernetes failover and failback with Trident CSI and SolidFire
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
Kubernetes failover and failback with Trident CSI and SolidFire
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
NetApp Trident v21.01.1 on Linux/ARM64 with SolidFire iSCSI storage
Intro Build \& Deploy What about s390x, ppc64le and other architectures Next steps Version info Notes on linux/s390x (Feb 25, 2021)
Limit CSI provisioner's blast radius for automatically provisioned ONTAP storage
Problem Solutions Demo
Install NetApp Trident v21.01.01 with Helm v3 and configure a SolidFire back-end
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Protect your Kubernetes with Kasten and SolidFire
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
storagegrid
Velero AWS Plugin and SignatureDoesNotMatch nonsense
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
NetApp StorageGRID networks
Introduction
Filesystem block size used by NetApp StorageGRID
So, what filesystem block size does StorageGRID 11.8 use?
Analyze HTTP logs from NetApp StorageGRID gateway nodes
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Kafka notifications in NetApp StorageGRID 11.8
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Delete old object versions on NetApp StorageGRID
Introduction
NetApp StorageGRID on VMware
Introduction Network Servers StorageGRID load balancer OS Storage Flash tier NL-SAS tier DDP vs RAID Gro...
Scan NetApp StorageGRID S3 buckets for viruses and malware
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Teradata Vantage with NetApp S3 object stores
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
Microsoft SQL Server data virtualization PolyBase with S3 Object Stores
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
StorageGRID and Elasticsearches
Why "Elasticsearches"?
Velero V1.8 with Restic, SolidFire 12.3 and StorageGRID 11.5
NOTICE: all credentials and tokens on this page are samples, not leaked.
S3 Select vs. remote SQL access to CSV over FUSE
In a recent post I wrote about S3 Select in StorageGRID 11.6.
StorageGRID S3 in Public Cloud workflows without Data-at-Rest
This week I heard of a StorageGRID customer who had a query about data processing in the cloud. Probably instinctively, their first idea was to copy data to ...
Using rclone to copy StorageGRID S3 data to local filesystem
NOTICE: all credentials and tokens on this page are samples, not leaked.
SGAC v0.2.1
Some two months ago I rewrote SGAC and released it as v0.1.
Red Hat Quay with NetApp StorageGRID S3 Back End
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
How to create StorageGRID object path-based ILM rule
Say you have a bucket called junk with "directory tree" (not really but…) several levels deep (junk/lev1/lev2) and want to do some ILM stuff on the stuff in ...
Copy StorageGRID objects and tags using rclone
Create two buckets, source and destination, a PUT a test object with some junk tags to source/.
SGAC v0.1
How it begun
NetApp StorageGRID for Vertica EON Mode
WTF is EON Mode What do I need to do to get Vertica EON Mode work with StorageGRID TLS certificate for HTTPS IP address for S3 API endp...
Use StorageGRID for private container registry
Docker Registry
StorageGRID as Cloud Storage (S3) Provider for Kasten K10
Previously I blogged about using Kasten with NetApp HCI and SolidFire, but I did not have time to examine another NetApp storage integration, namely that of ...
Backup Rancher cluster configuration to NetApp StorageGRID
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
StorageGRID object versioning
"There's no documentation" is different from "there are no copy-paste examples".
Virtualized StorageGRID for Splunk Smartstore on NetApp HCI and EF-Series array
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
csi
Extract SolidFire volume attributes created by Trident or other apps
This series of posts has several parts:
NetApp E-Series with containerized BeeGFS, NFS, S3
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
Use Velero with NetApp Verda and Trident CSI
What is Verda Example with Redis Conclusion
Velero v1.13 metadata, hooks with NetApp Trident v24.02
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Kubernetes KEDA with NetApp SolidFire and E-Series
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Velero 1.12 and CSI Snapshot Data Movement with NetApp SolidFire
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
ThinkParQ takes over NetApp-created BeeGFS CSI driver
I've written several posts about NetApp's BeeGFS CSI driver.
Block volume mode in Kubernetes with SolidFire
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
StatefulSet PVC Retention with Trident and SolidFire
Introduction
What's new in NetApp Trident v23.07
Introduction
CloudCasa, Velero, NetApp Trident, and SolidFire
Table of Contents
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
NetApp BeeGFS CSI driver 1.4.0
This week NetApp released BeeGFS CSI driver v1.4.0 which adds support for newer Kubernetes and BeeGFS.
E-Series in a Kubernetes environment with DirectPV, TopoLVM, CSI Driver LVM CSI drivers
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
Velero 1.9 with AWS and CSI plugins for ARM64
Introduction Non-CSI with Restic and NetApp BeeGFS CSI CSI with NetApp Trident What's new in 1.9 and 1.8 Velero on ARM64 Restic (ARM64)...
Speed of volume creation with BeeGFS CSI
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
NetApp Trident v22.07.0 for ARM64
I had thought the posts I wrote about Trident on ARM64 were enough to get almost everyone going, but it seems it's not hard to get stuck.
Kubernetes with vSphere CSI Plugin and NetApp E-Series
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
Trident CSI REST API
Why access Trident API Controller routes Trident resources Expose the Trident REST API Examples What about it Appendix: List of Trident Resour...
BeeGFS and BeeGFS CSI on ARM64
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
Ephemeral volumes with BeeGFS CSI provisioner on Kubernetes
One of more obvious characteristics of Persistent Volumes is they persist, i.e. survive pod(s) that use them until the claim for the PV itself is deleted, as...
Backup and restore NetApp BeeGFS CSI PVs with Kanister
Introduction What Kanister does Summary Demo
An introduction to NetApp BeeGFS CSI
Introduction Use cases Getting started Options in a mixed environment Deploy and use BeeGFS CSI Data protection Summary Demo
Kubernetes with Cinder CSI Plugin on Openstack Yoga/Xena with SolidFire 12.3 - Part 1
NOTICE: all credentials and tokens on this page are samples, not leaked.
GA of NetApp Trident v21.07
Latest & greatest NetApp Trident is out!
Fetch Trident's SolidFire metrics from outside of your container environment
If I had a SolidFire array in a VM and container environment (which I do), I'd prefer to run Prometheus and Grafana in VMs, rather than cram the monitoring i...
GA of NetApp Trident v21.04
What Upgrade procedure Before Out with the old, in with the new Verify success Trident for ARM64 and other non-AMD64 ar...
NetApp Trident v21.01.1 on Linux/ARM64 with SolidFire iSCSI storage
Intro Build \& Deploy What about s390x, ppc64le and other architectures Next steps Version info Notes on linux/s390x (Feb 25, 2021)
Limit CSI provisioner's blast radius for automatically provisioned ONTAP storage
Problem Solutions Demo
beegfs
Data pipeline with BeeGFS FS Event Notifications and Versity S3 Gateway
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Improved pipelines with BeeGFS FS Event Notifications in v8
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
OPEA AI with NetApp E-Series
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
EConfig v2
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
Containerized BeeGFS with NetApp E-Series
Introduction
Versity S3 Gateway with BeeGFS
What Config How Using Conclusion Appendix - External performance test
ThinkParQ takes over NetApp-created BeeGFS CSI driver
I've written several posts about NetApp's BeeGFS CSI driver.
Burst on-prem GPU workloads from BeeGFS/E-Series clusters to Spot Ocean for Spark in the cloud
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
iRODS or Robinhood HSM with BeeGFS
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
BeeGFS filesystem event monitoring with watcher
Maybe you've used an app (or an ONTAP feature) that makes use of the FPolicy API. FPolicy is proven in large and busy NAS environments, and has rich features...
Speed of volume creation with BeeGFS CSI
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
Low-hanging BeeGFS efficiency fruit
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
TensorStore with BeeGFS
TensorStore is a new C++ and Python library that provides a uniform API for reading and writing n-dimensional data.
LXD containers and VMs on BeeGFS with NetApp E-Series
Introduction Why LXD on BeeGFS (with or without NetApp E-Series) Get started Optimal BeeGFS settings HA BeeGFS client in LXD VMs on LXD server a...
Configuration approaches to NetApp E-Series with ThinkParQ BeeGFS
It may not be easy to digest how BeeGFS with NetApp E-Series is usually configured.
Send BeeGFS and NetApp E-Series performance metrics to InfluxDB v2 or scrape them form Prometheus
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad pack for InfluxDB with BeeGFS filesystem
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
Leverage BeeGFS in Nextflow to avoid unnecessary data movement
Nextflow configuration and environment variables allow us to make use of BeeGFS with E-Series for most demanding IO tasks.
Apptainer with BeeGFS
Apptainer is based on the Singularity project.
Copy files to/from BeeGFS before or after scheduled jobs
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
BeeGFS and BeeGFS CSI on ARM64
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
Scaling out Nomad batch jobs with BeeGFS and NetApp E-Series
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Backup and restore NetApp BeeGFS CSI PVs with Kanister
Introduction What Kanister does Summary Demo
An introduction to NetApp BeeGFS CSI
Introduction Use cases Getting started Options in a mixed environment Deploy and use BeeGFS CSI Data protection Summary Demo
Nomad batch jobs with BeeGFS and E-Series
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
HashiCorp Nomad CSI with NetApp SolidFire and E-Series back-ends
Introduction NetApp E-Series NetApp BeeGFS CSI Other CSI provisioners and non-CSI approaches NetApp SolidFire Cind...
BeeGFS on NetApp HCI with EF280 for high-speed file access from Virtual Machines
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
data protection
Velero AWS Plugin and SignatureDoesNotMatch nonsense
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
NetApp SolidFire backup to S3 and MinIO compression savings
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
SolidBackup with Kopia
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
Use Simple Backups to file-backup cloned SolidFire volumes to S3/B2
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
Use SolidFire API to monitor clone and backup jobs for profit and pleasure
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Use ONTAP S3 as backup destination for Velero
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
CloudCasa, Velero, NetApp Trident, and SolidFire
Table of Contents
Velero 1.10 with NetApp Trident and SolidFire
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Backup/restore E-Series Performance Analyzer with Kasten K10
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Store Kasten backups on NetApp E-Series
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
SolidFire Backup to S3 with Object Lock
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
Rest Server with NetApp E-Series
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
Velero V1.8 with Restic, SolidFire 12.3 and StorageGRID 11.5
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidFire v12 Backup and Restore with Wasabi S3
It's very easy and works as you expected:
Replicate volume data from Digital Ocean to SolidFire and back
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
Logical backup vs. storage-assisted backup with Kasten v4 and SolidFire 12
To answer the question quickly: logical backups make sense.
Maximum parallelization of SolidFire Backup and Volume Copy/Clone jobs
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
SolidBackup with alternative backup clients
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
SolidFire, KVM, Duplicati and S3 Object Storage
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
Backup SolidFire volumes to S3-compatible storage
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Kubernetes data protection and storage management with NetApp SolidFire and Kasten K10
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
StorageGRID as Cloud Storage (S3) Provider for Kasten K10
Previously I blogged about using Kasten with NetApp HCI and SolidFire, but I did not have time to examine another NetApp storage integration, namely that of ...
Backup Rancher cluster configuration to NetApp StorageGRID
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NetApp HCI with Cloud Backup Service
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
Protect your Kubernetes with Kasten and SolidFire
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
powershell
Firemox - an anti-plugin for Proxmox PVE with NetApp SolidFire
Background Firemox What it does, and doesn't (Stopping) scope creep Known issues and limitations Conclusion Demo and source c...
Fix slow PowerShell startup time on Linux due to misconfigured environment
Problem Background Solution(s) Epilogue
Increase size of SolidFire volumes paired for replication
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
Use Telegraf to send NetApp SolidFire metrics to InfluxDB
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Two
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
NetApp SANtricity PowerShell module for E-Series
Get NetApp.SANtricity module for PowerShell 5.1 Install and load Use End Appendix A - Known issues \& workarounds
Monitor progress and notify of E-Series media scan events
Introduction SANtricity API methods related to scrubbing, scanning, fixing data issues Media scan in Web UI Relevant API methods Implementation ...
Stand-alone and Consistency Group snapshots on NetApp E-Series
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Monitoring NetApp E-Series with PRTG
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Use SolidFire API to monitor clone and backup jobs for profit and pleasure
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Using snapshot attributes in SolidFire
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
PowerShell password change script for local user account on E-Series SANtricity OS
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
New Dynamic Disk Pool configuration and E-Series SANtricity
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
SolidFire capacity and efficiency report generator
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Manage SolidFire from Jupyter Python or .NET notebooks
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Getting SolidFire volume details with Powershell and Python
Just a few examples for those who struggle to get started.
Using NetApp SolidFire Hybrid Cloud Control (HCC) API from PowerShell
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Maximum parallelization of SolidFire Backup and Volume Copy/Clone jobs
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
NetApp SolidFire and Trident CSI failover automation with Powershell
While experimenting with SolidFire and Trident CSI failover for Kubernetes, I came across a challenge:
SolidFire PowerShell Tools, Python CLI and SDK pip packages v1.7
This is a nice Christmas present as far as I am concerned, because it's been a while since SolidFire PowerShell tools, sfcli and their respective SDKs v1.5 h...
Get NetApp Hybrid Cloud Control logs via the HCC API
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
Set Temporary Storage QoS Policy for SolidFire Volume
Say we have a Volume ID 321 with a storage QoS Policy ID 5, and need to run a temporary job that would benefit from a different Storage QoS Policy (higher or...
python
Kubefire - tools and recipes for Kubernetes failover/failback with SolidFire
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
Use Telegraf to send NetApp SolidFire metrics to InfluxDB
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Stand-alone and Consistency Group snapshots on NetApp E-Series
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Use SolidFire API to monitor clone and backup jobs for profit and pleasure
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
Notes on NetApp E-Series Performance Analyzer
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
New Dynamic Disk Pool configuration and E-Series SANtricity
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
SolidFire Collector on Kubernetes
What is SFC Making SolidFire Collector work with Kubernetes Appendix: Deploymennt for SFC and Graphite
SolidFire Operator for Kubernetes
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
Simplify data workflows with Kestra
Introduction
Getting SolidFire volume details with Powershell and Python
Just a few examples for those who struggle to get started.
Using NetApp SolidFire Hybrid Cloud Control (HCC) API from PowerShell
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SGAC v0.2.1
Some two months ago I rewrote SGAC and released it as v0.1.
SGAC v0.1
How it begun
Hardware monitoring of NetApp HCI compute nodes for dark sites
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
Get started with solidfire-exporter
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Announcing HCICollector v0.7
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
SolidFire PowerShell Tools, Python CLI and SDK pip packages v1.7
This is a nice Christmas present as far as I am concerned, because it's been a while since SolidFire PowerShell tools, sfcli and their respective SDKs v1.5 h...
Get NetApp Hybrid Cloud Control logs via the HCC API
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
devops
Extract SolidFire volume attributes created by Trident or other apps
This series of posts has several parts:
Increase size of SolidFire volumes paired for replication
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
Access NetApp SolidFire API with Async IO
Introduction
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Two
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
NetApp SANtricity PowerShell module for E-Series
Get NetApp.SANtricity module for PowerShell 5.1 Install and load Use End Appendix A - Known issues \& workarounds
NetApp SolidFire with GenAI and inferencing workloads
Introduction Inferencing with SolidFire Examples Making use of iSCSI Share data with a parallel file system Share ...
Using synthetic SolidFire S3 backups for Dev/Test purposes
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
E-Series SANtricity API with JWT aka Bearer Tokens
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
SolidFire Operator for Kubernetes
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
Create and maintain SolidFire volumes and accounts with Terraform
NOTICE: all credentials and tokens on this page are samples, not leaked.
Using NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Getting SolidFire volume details with Powershell and Python
Just a few examples for those who struggle to get started.
Using Terraform 1.0.6 with SolidFire 12.3
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Maximum parallelization of SolidFire Backup and Volume Copy/Clone jobs
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
Use SolidFire PowerShell Tools to find low efficiency volumes
NetApp Hybrid Cloud Control (HCC) lets you access volume details to a slightly greater detail than the SolidFire Web UI. One additional detail that we are in...
SolidFire PowerShell Tools, Python CLI and SDK pip packages v1.7
This is a nice Christmas present as far as I am concerned, because it's been a while since SolidFire PowerShell tools, sfcli and their respective SDKs v1.5 h...
Set Temporary Storage QoS Policy for SolidFire Volume
Say we have a Volume ID 321 with a storage QoS Policy ID 5, and need to run a temporary job that would benefit from a different Storage QoS Policy (higher or...
SolidFire Provider for Terraform
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
kubernetes
NetApp E-Series with containerized BeeGFS, NFS, S3
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
Quickly install NetApp Trident v24.02 on ARM64 Kubernetes
Here we go again…
Kubernetes KEDA with NetApp SolidFire and E-Series
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
Containerized BeeGFS with NetApp E-Series
Introduction
ThinkParQ takes over NetApp-created BeeGFS CSI driver
I've written several posts about NetApp's BeeGFS CSI driver.
Block volume mode in Kubernetes with SolidFire
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
Azure Linux with SolidFire iSCSI targets
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
CloudCasa, Velero, NetApp Trident, and SolidFire
Table of Contents
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
GA of NetApp Trident v21.07
Latest & greatest NetApp Trident is out!
NetApp SolidFire and Trident CSI failover automation with Powershell
While experimenting with SolidFire and Trident CSI failover for Kubernetes, I came across a challenge:
Kubernetes data protection and storage management with NetApp SolidFire and Kasten K10
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Install NetApp Trident v21.01.01 with Helm v3 and configure a SolidFire back-end
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Backup Rancher cluster configuration to NetApp StorageGRID
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Get Rancher Kubernetes deployment log for on NetApp HCI mNode
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Rancher Kubernetes Layer-7 NLB/Ingress with NGINX Plus and Let's Encrypt
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Deploying Rancher Worker VMs to NetApp HCI with VMware VSS
Earlier this week I spotted the advice to not select a VM host when deploying Rancher worker VMs to a vSphere environment where DRS is enabled, because "DRS ...
solid-rancher
solid-rancher is a Github repo I created to organize and enrich information related to Rancher on SolidFire (and NetApp HCI in general).
hci
VMware license calculator for VVF and VCF
Introduction VMware's calculator (KB 96426) Example for NetApp HCI Conclusion
Add NetApp SolidFire iSCSI storage to KVM
Introduction Storage options exposed in Virtual Manager Filesystem directory Physical disk device Preformatted block device ...
How to change NetApp HCI from VMware to alternatives
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
Check Active IQ connectivity from HCC on SolidFire mNode
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
Using NetApp SolidFire Hybrid Cloud Control (HCC) API from PowerShell
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire Maintenance Mode
Maintenance Mode is a relatively new SolidFire feature that takes a node in and out of the neutral. In other words, it nicely moves a node's services to rema...
Hardware monitoring of NetApp HCI compute nodes for dark sites
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
Get started with solidfire-exporter
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Announcing HCICollector v0.7
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
Get Rancher Kubernetes deployment log for on NetApp HCI mNode
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
NetApp HCI with Cloud Backup Service
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
Virtualized StorageGRID for Splunk Smartstore on NetApp HCI and EF-Series array
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Elasticsearch on NetApp HCI H615C with EF-Series EF280
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
BeeGFS on NetApp HCI with EF280 for high-speed file access from Virtual Machines
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
Adapter, network and VLAN isolation on NetApp HCI
This comes up every so often:
Get NetApp Hybrid Cloud Control logs via the HCC API
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
SolidFire mNode and HCC Log Fowarding
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
solid-rancher
solid-rancher is a Github repo I created to organize and enrich information related to Rancher on SolidFire (and NetApp HCI in general).
iscsi
Do we need a NetApp SolidFire plugin for Proxmox
Who wants it and why? Perl for the win! Features Effort Appendix A: what works and how Appendix B: observations, problems, solutions Appendix ...
Windows Server 2025 with NetApp SolidFire
I wrote about Windows Server 2025 here.
Boot OpenShift RCOS from NetApp SolidFire iSCSI target
Introduction How Other SolidFire-related tips Conclusion
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Two
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Three
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Ubuntu 22.04 LTS as iSER client to NetApp E-Series
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
Rocky Linux 8 and 9 added to NetApp E-Series interoperability matrix
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
SolidFire Backup to S3 over Storage Network
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
Rocky Linux 8 and 9 with NetApp Trident Docker volume plugin and SolidFire 12 iSCSI storage
The official Trident documentation is okay, but it mentions no Rocky Linux.
Consume SolidFire storage from Proxmox hosts
Configure Proxmox 7.1 with SolidFire 12.3 SolidFire Demo VM on Proxmox
HashiCorp Nomad with NetApp SolidFire-backed iSCSI volumes
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
Flatcar Container Linux with SolidFire iSCSI
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Data Path in SolidFire clusters with Protection Domains
In the post that compares SolidFire Protection Domains with Availability Zones I had this illustration of network connectivity among SolidFire v12 cluster no...
Virtualized Splunk on NetApp HCI and EF Series iSCSI storage
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
How much slower is iSCSI vs. Fibre Channel
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
automation
Fix slow PowerShell startup time on Linux due to misconfigured environment
Problem Background Solution(s) Epilogue
Kubefire - tools and recipes for Kubernetes failover/failback with SolidFire
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
Snapshots and snapshot schedules in SFC v2
Introduction
Trident QoS policy sucker for SolidFire backend
Pull QoS policy from SolidFire into Trident back-end configuration for solidfire-san Exercise care What does the IOPS really do? What does all this ...
Snapshots and snapshot schedules in NetApp SolidFire
Introduction Slightly confusing SolidFire snapshot schedules Create a schedule Group vs. single One volume, multiple schedules FIFO settings ...
SFC v2 adds volume replication monitoring
What replication monitoring? What does that mean? What can we see? Other implementation details Grafana aside Summary
Monitoring volume replication in NetApp SolidFire
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
Project Longhorny
Introduction What exactly does Longhorny do? Longhorny walk-through Site-level actions Conclusion Demo
Kubernetes, Trident and SolidFire configuration - part 2
Introduction Use cases Feed Trident volume list to Velero Create backup-to-S3 jobs on SolidFire Set up cross-site replication for...
Kubernetes, Trident and SolidFire configuration visibility
Introduction Mapping applications to Kubernetes PVCs with kubectl Mapping PVCs to storage with tridentctl Mapping Trident to SolidFire with scripts ...
Access NetApp SolidFire API with Async IO
Introduction
Tenant (account) attributes on NetApp SolidFire
It took me a while
Swagger files for NetApp E-Series
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
OpenAPI and SolidFire
SolidFire doesn't have an OpenAPI interface. See here.
New Dynamic Disk Pool configuration and E-Series SANtricity
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
Copy files to/from BeeGFS before or after scheduled jobs
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
performance
E-Series Performance Analyzer (EPA) v4 beta
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
InfluxDB 3 Core Alpha available for testing
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
Use Telegraf to send NetApp SolidFire metrics to InfluxDB
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Access NetApp SolidFire API with Async IO
Introduction
Towards next SolidFire Collector (SFC)
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Faster PostgreSQL with DDP-based RAID 1 compared to DDP-based RAID 6
Introduction Environment Tests Results Other performance views Conclusion
Flash media overprovisioning on NetApp E-Series
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
Notes on MinIO performance with NetApp E-Series
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
Oracle TimesTen Classic XE notes
Oracle TimesTen XE Classic v22.1 has quite a few requirements and settings related to memory and storage. Some attributes directly and indirectly related to ...
Display per-storage node performance guarantees of SolidFire nodes
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
Evaluating ONTAP S3 performance with s3tester
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
Splunk sizing with shared core HCI vendors
In recent weeks I've done a fair amount of reading about log management solutions, and I have to say the quality of technical material related to Splunk and ...
BeeGFS on NetApp HCI with EF280 for high-speed file access from Virtual Machines
Summary Why and when run BeeGFS in NetApp HCI VMs Aren't shared file systems complex to deploy and manage How do automation and virtualization help ...
DiskSpd performance from NetApp HCI VM to EF280
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
How much slower is iSCSI vs. Fibre Channel
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
visualization
SolidFire Collector v2.0.0 is ready
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Visualize E-Series temperature and power consumption metrics with EPA
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Use Cloud Sync API and Elasticsearch to improve data replication
Why and when automate Cloud Sync?
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
Monitor wear level of NetApp E-Series flash drives via the API and from the CLI
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidFire SNMP v3, Telegraf, Prometheus, Grafana
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SGAC v0.1
How it begun
Monitor SolidFire Network with SolidFire-Exporter, Prometheus and Grafana
In the first solidfire-exporter post I went through the first two steps required to gather SolidFire (or NetApp HCI) data and get it into Prometheus. I also ...
Hardware monitoring of NetApp HCI compute nodes for dark sites
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
Get started with solidfire-exporter
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Announcing HCICollector v0.7
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
Virtualized StorageGRID for Splunk Smartstore on NetApp HCI and EF-Series array
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Elasticsearch on NetApp HCI H615C with EF-Series EF280
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
ontap
Minimal Prometheus Exporter with ONTAP Harvest
Introduction Approach Steps One or more instances Prepare your box Clone Harvest repo or download pre-built container image ...
Velero AWS Plugin and SignatureDoesNotMatch nonsense
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
What's new in NetApp Trident v23.07
Introduction
Use ONTAP S3 as backup destination for Velero
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
Zero-out and rethin VMDKs on NFS
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
Evaluating ONTAP S3 performance with s3tester
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
Red Hat Quay with NetApp ONTAP S3
NOTICE: all credentials and tokens on this page are samples, not leaked.
Testing Edge-to-DC using Photon IoT and ONTAP
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
Limit CSI provisioner's blast radius for automatically provisioned ONTAP storage
Problem Solutions Demo
NetApp HCI with Cloud Backup Service
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
replication
Kubefire - tools and recipes for Kubernetes failover/failback with SolidFire
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
Extract SolidFire volume attributes created by Trident or other apps
This series of posts has several parts:
Increase size of SolidFire volumes paired for replication
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
SFC v2 adds volume replication monitoring
What replication monitoring? What does that mean? What can we see? Other implementation details Grafana aside Summary
Monitoring volume replication in NetApp SolidFire
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
Project Longhorny
Introduction What exactly does Longhorny do? Longhorny walk-through Site-level actions Conclusion Demo
Kubernetes, Trident and SolidFire configuration - part 2
Introduction Use cases Feed Trident volume list to Velero Create backup-to-S3 jobs on SolidFire Set up cross-site replication for...
Kubernetes, Trident and SolidFire configuration visibility
Introduction Mapping applications to Kubernetes PVCs with kubectl Mapping PVCs to storage with tridentctl Mapping Trident to SolidFire with scripts ...
Backup and replicate Kubernetes PVs with SolidFire using VolSync
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
Containerized Cloud Sync Data Broker for Docker, Kubernetes and Nomad
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
Using rclone to copy StorageGRID S3 data to local filesystem
NOTICE: all credentials and tokens on this page are samples, not leaked.
Replicate volume data from Digital Ocean to SolidFire and back
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
grafana
E-Series Performance Analyzer (EPA) v4 beta
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next
SFC (SolidFire Collector) 2.1
Introduction SFC 2.1 Queries Summary
SolidFire Collector v2.0.0 is ready
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Make use of storage QoS histograms on NetApp SolidFire
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Use Telegraf to send NetApp SolidFire metrics to InfluxDB
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Towards next SolidFire Collector (SFC)
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Metrics for NetApp SolidFire backup-to-S3 in InfluxDB and Grafana
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
NetApp SolidFire Collector with Grafana 11
You may have heard Grafana 11 is coming out soon.
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
Monitor wear level of NetApp E-Series flash drives via the API and from the CLI
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
SSD disk wear indicator in E-Series SANtricity 11.70
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
Notes on NetApp E-Series Performance Analyzer
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
SolidFire SNMP v3, Telegraf, Prometheus, Grafana
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
snapshot
The shocking truth about SolidFire ModifySchedule method
Introduction Show me Why? Thoughts Conclusion
Snapshots and snapshot schedules in SFC v2
Introduction
Snapshots and snapshot schedules in NetApp SolidFire
Introduction Slightly confusing SolidFire snapshot schedules Create a schedule Group vs. single One volume, multiple schedules FIFO settings ...
Use Velero with NetApp Verda and Trident CSI
What is Verda Example with Redis Conclusion
Velero v1.13 metadata, hooks with NetApp Trident v24.02
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Calculate snapshot capacity utilization on NetApp SolidFire
Introduction Clone and analyze Example with Postgres writeBytes metric Cost issue Do we still need to clone those snapshots? How to minimize s...
Monitor Snapshot Consistency Groups of NetApp E-Series SANtricity OS
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Monitor snapshot and clone repositories of NetApp E-Series SANtricity OS
Problem statement Considerations First iteration Second iteration Conclusion
Stand-alone and Consistency Group snapshots on NetApp E-Series
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Velero 1.12 and CSI Snapshot Data Movement with NetApp SolidFire
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
Using snapshot attributes in SolidFire
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
Backup and replicate Kubernetes PVs with SolidFire using VolSync
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Minimizing ransomware risks for SolidFire data
SolidFire vs. Ransomware
restore
Backup NetApp SolidFire's non-Kubernetes volumes with Velero
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
Use Velero with NetApp Verda and Trident CSI
What is Verda Example with Redis Conclusion
Velero v1.13 metadata, hooks with NetApp Trident v24.02
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
NetApp E-Series DAS or SAN storage as Veeam Hardened Repository
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
NetApp SolidFire backup to S3 and MinIO compression savings
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
SolidBackup with Kopia
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
Use Simple Backups to file-backup cloned SolidFire volumes to S3/B2
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
Using synthetic SolidFire S3 backups for Dev/Test purposes
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
SolidFire backup-to-S3 with Backblaze
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
SolidFire backup-to-S3 with Backblaze
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
SolidFire backup-to-S3 using ONTAP S3 destination
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Maximum parallelization of SolidFire Backup and Volume Copy/Clone jobs
SolidFire can backup volumes to S3-compatible Object Storage. How to do it in parallel, I wrote about here.
elasticsearch
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 vector search - DIY vs AWS S3 Vectors
This is a two-part post:
Kafka notifications in NetApp StorageGRID 11.8
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
StorageGRID and Elasticsearches
Why "Elasticsearches"?
Elasticsearch performance with E-Series
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
SGAC v0.2.1
Some two months ago I rewrote SGAC and released it as v0.1.
Elasticsearch on NetApp HCI H615C with EF-Series EF280
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
velero
Velero AWS Plugin and SignatureDoesNotMatch nonsense
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Backup NetApp SolidFire's non-Kubernetes volumes with Velero
Intro Using Kubernetes to backup non-Kubernetes volumes Dealing with alien filesystems Workflow for backup of non-K8s volumes on SolidFire using Vel...
Use Velero with NetApp Verda and Trident CSI
What is Verda Example with Redis Conclusion
Velero v1.13 metadata, hooks with NetApp Trident v24.02
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
Velero 1.12 and CSI Snapshot Data Movement with NetApp SolidFire
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
Use ONTAP S3 as backup destination for Velero
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
CloudCasa, Velero, NetApp Trident, and SolidFire
Table of Contents
Velero 1.10 with NetApp Trident and SolidFire
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Velero 1.9 with AWS and CSI plugins for ARM64
Introduction Non-CSI with Restic and NetApp BeeGFS CSI CSI with NetApp Trident What's new in 1.9 and 1.8 Velero on ARM64 Restic (ARM64)...
Velero V1.8 with Restic, SolidFire 12.3 and StorageGRID 11.5
NOTICE: all credentials and tokens on this page are samples, not leaked.
santricity
Using NetApp E-Series Volume Copy
What is a volume created by Volume Copy operation How does it work? Progress Reserve size Reserve location Priority Automating Volume Copy A...
Swagger files for NetApp E-Series
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
Swagger files for NetApp E-Series
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
Monitor progress and notify of E-Series media scan events
Introduction SANtricity API methods related to scrubbing, scanning, fixing data issues Media scan in Web UI Relevant API methods Implementation ...
NetApp E-Series DAS or SAN storage as Veeam Hardened Repository
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
Stand-alone and Consistency Group snapshots on NetApp E-Series
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Flash media overprovisioning on NetApp E-Series
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
Monitor wear level of NetApp E-Series flash drives via the API and from the CLI
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
SSD disk wear indicator in E-Series SANtricity 11.70
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
Prometheus exporter for NetApp E-Series SANtricity OS
NetApp E-Series Prometheus Exporter
PowerShell password change script for local user account on E-Series SANtricity OS
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
E-Series SANtricity API with JWT aka Bearer Tokens
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
analytics
Simple file share and S3 analytics and MCP ops
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
Postgres, pgvector, E-Series and Instaclustr
NOTICE: all credentials and tokens on this page are samples, not leaked.
Storage considerations for Memphis message broker
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
Use cases for AWS mountpoint-s3 with NetApp E-Series and SolidFire
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Elasticsearch performance with E-Series
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Burst on-prem GPU workloads from BeeGFS/E-Series clusters to Spot Ocean for Spark in the cloud
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
Nomad batch jobs with BeeGFS and E-Series
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
storage
Trident QoS policy sucker for SolidFire backend
Pull QoS policy from SolidFire into Trident back-end configuration for solidfire-san Exercise care What does the IOPS really do? What does all this ...
Snapshots and snapshot schedules in NetApp SolidFire
Introduction Slightly confusing SolidFire snapshot schedules Create a schedule Group vs. single One volume, multiple schedules FIFO settings ...
SFC v2 adds volume replication monitoring
What replication monitoring? What does that mean? What can we see? Other implementation details Grafana aside Summary
Monitoring volume replication in NetApp SolidFire
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
Project Longhorny
Introduction What exactly does Longhorny do? Longhorny walk-through Site-level actions Conclusion Demo
Kubernetes, Trident and SolidFire configuration - part 2
Introduction Use cases Feed Trident volume list to Velero Create backup-to-S3 jobs on SolidFire Set up cross-site replication for...
Kubernetes, Trident and SolidFire configuration visibility
Introduction Mapping applications to Kubernetes PVCs with kubectl Mapping PVCs to storage with tridentctl Mapping Trident to SolidFire with scripts ...
Make use of storage QoS histograms on NetApp SolidFire
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Milvus with SolidFire and E-Series
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
log
Analyze HTTP logs from NetApp StorageGRID gateway nodes
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Gathering and forwarding E-Series SANtricity Major Event Log (MEL)
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
Forward E-Series SANtricity logs to remote syslog server
Configure SANtricity to send array events to a remote syslog server
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
SGAC v0.2.1
Some two months ago I rewrote SGAC and released it as v0.1.
SGAC v0.1
How it begun
Improve SolidFire Support Bundle Log Generation and Upload with Automation and OneCollect
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire mNode and HCC Log Fowarding
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
minio
What is MinIO up to these days?
"Adjustments" Latest and greatest: "breaking changes" Are you telling me there's a chance? Thoughts Risk and commercial ...
MinIO and Versity S3 GW with tiny object workloads on NetApp E-Series
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
Fixing Web UI annoyances with element blocking
While using ehm, a famous S3 server, I got annoyed by this stupid red dot.
NetApp SolidFire backup to S3 and MinIO compression savings
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
MinIO Erasure Coding with NetApp E-Series
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
Notes on MinIO performance with NetApp E-Series
I've written about several ways we can take advantage of MinIO with NetApp E-Series back-ends, for example in the post on MinIO on HashiCorp Nomad with BeeGF...
Simple S3 service endpoint for BeeGFS using Hashicorp Nomad and stand-alone MinIO
I have a small Nomad cluster which can access a BeeGFS filesystem.
influxdb
Use Telegraf to send NetApp SolidFire metrics to InfluxDB
Telegraf for heavy lifting? PoC with PowerShell Conclusion Appendix A - Python version
Towards next SolidFire Collector (SFC)
WTF is SFC? Why bother when no one is using it? Progress so far Conclusion
Metrics for NetApp SolidFire backup-to-S3 in InfluxDB and Grafana
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Backup/restore E-Series Performance Analyzer with Kasten K10
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
Notes on NetApp E-Series Performance Analyzer
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
Send BeeGFS and NetApp E-Series performance metrics to InfluxDB v2 or scrape them form Prometheus
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad pack for InfluxDB with BeeGFS filesystem
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
epa
InfluxDB 3 Core Alpha available for testing
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Elasticsearch performance with E-Series
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Visualize E-Series temperature and power consumption metrics with EPA
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Backup/restore E-Series Performance Analyzer with Kasten K10
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
Monitor wear level of NetApp E-Series flash drives via the API and from the CLI
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
SSD disk wear indicator in E-Series SANtricity 11.70
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
Notes on NetApp E-Series Performance Analyzer
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
ai
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
OPEA AI with NetApp E-Series
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
Build NetApp SolidFire MCP server
Introduction MCP Use cases? Get, set, and security Conclusion Additional reading
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
NetApp E-Series with containerized BeeGFS, NFS, S3
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
Postgres, pgvector, E-Series and Instaclustr
NOTICE: all credentials and tokens on this page are samples, not leaked.
Postgres, pgvector, E-Series and Instaclustr
NOTICE: all credentials and tokens on this page are samples, not leaked.
NetApp SolidFire with GenAI and inferencing workloads
Introduction Inferencing with SolidFire Examples Making use of iSCSI Share data with a parallel file system Share ...
Basic notes on h2o GPT from a storage perspective
So… I don't use Generative AI.
workflow
Leverage BeeGFS in Nextflow to avoid unnecessary data movement
Nextflow configuration and environment variables allow us to make use of BeeGFS with E-Series for most demanding IO tasks.
Copy files to/from BeeGFS before or after scheduled jobs
While the ability to move files (or blocks) from and to other filesystems is nice, it isn't always necessary or desirable.
Scaling out Nomad batch jobs with BeeGFS and NetApp E-Series
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Nomad batch jobs with BeeGFS and E-Series
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
Manage SolidFire from Jupyter Python or .NET notebooks
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Simplify data workflows with Kestra
Introduction
SolidFire RBAC workflow with Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
StorageGRID S3 in Public Cloud workflows without Data-at-Rest
This week I heard of a StorageGRID customer who had a query about data processing in the cloud. Probably instinctively, their first idea was to copy data to ...
windows
SolidFire Extension for Windows Admin Center 2025
Introduction Walk-through And now… Conclusion Appendix A: demo Animated GIF (no playback control) Video demo with voice-over ...
SolidFire Gateway for Windows Admin Center 2025
Introduction What it is What it does IIS Setup Why this matters What about it? Conclusion
Windows Server 2025 with NetApp SolidFire
I wrote about Windows Server 2025 here.
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Two
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Three
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
NetApp SANtricity PowerShell module for E-Series
Get NetApp.SANtricity module for PowerShell 5.1 Install and load Use End Appendix A - Known issues \& workarounds
UNMAP/TRIM Hyper-V volumes backed by NetApp SolidFire
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
plugin
Velero AWS Plugin and SignatureDoesNotMatch nonsense
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Monitoring NetApp E-Series with PRTG
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Velero 1.9 with AWS and CSI plugins for ARM64
Introduction Non-CSI with Restic and NetApp BeeGFS CSI CSI with NetApp Trident What's new in 1.9 and 1.8 Velero on ARM64 Restic (ARM64)...
Create and maintain SolidFire volumes and accounts with Terraform
NOTICE: all credentials and tokens on this page are samples, not leaked.
Integrate SolidFire with ServiceNow
This is speculative and I haven't tried it, but it looks very interesting.
Using Terraform 1.0.6 with SolidFire 12.3
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire Provider for Terraform
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
elk
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
StorageGRID and Elasticsearches
Why "Elasticsearches"?
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
SGAC v0.2.1
Some two months ago I rewrote SGAC and released it as v0.1.
Elasticsearch on NetApp HCI H615C with EF-Series EF280
Summary Test results Configuration Elasticsearch data protection with EF-Series Workload description Performan...
arm64
Quickly install NetApp Trident v24.02 on ARM64 Kubernetes
Here we go again…
What's new in NetApp Trident v23.07
Introduction
Velero 1.9 with AWS and CSI plugins for ARM64
Introduction Non-CSI with Restic and NetApp BeeGFS CSI CSI with NetApp Trident What's new in 1.9 and 1.8 Velero on ARM64 Restic (ARM64)...
NetApp Trident v22.07.0 for ARM64
I had thought the posts I wrote about Trident on ARM64 were enough to get almost everyone going, but it seems it's not hard to get stuck.
BeeGFS and BeeGFS CSI on ARM64
BeeGFS 7.3.0 for ARM64 Attempt 1 Attempt 2 Video walk-through
Testing Edge-to-DC using Photon IoT and ONTAP
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
NetApp Trident v21.01.1 on Linux/ARM64 with SolidFire iSCSI storage
Intro Build \& Deploy What about s390x, ppc64le and other architectures Next steps Version info Notes on linux/s390x (Feb 25, 2021)
prometheus
Minimal Prometheus Exporter with ONTAP Harvest
Introduction Approach Steps One or more instances Prepare your box Clone Harvest repo or download pre-built container image ...
Prometheus exporter for NetApp E-Series SANtricity OS
NetApp E-Series Prometheus Exporter
Send BeeGFS and NetApp E-Series performance metrics to InfluxDB v2 or scrape them form Prometheus
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
SolidFire SNMP v3, Telegraf, Prometheus, Grafana
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Monitor SolidFire Network with SolidFire-Exporter, Prometheus and Grafana
In the first solidfire-exporter post I went through the first two steps required to gather SolidFire (or NetApp HCI) data and get it into Prometheus. I also ...
Get started with solidfire-exporter
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
visualize
Prometheus exporter for NetApp E-Series SANtricity OS
NetApp E-Series Prometheus Exporter
Notes on NetApp E-Series Performance Analyzer
Should we use E-Series Performance Analyzer or SANtricity Web UI to monitor E-Series performance Various E-Series Performance Analyzer (EPA) notes ...
Send BeeGFS and NetApp E-Series performance metrics to InfluxDB v2 or scrape them form Prometheus
NOTE: Since BeeGFS v7.3.3 there's an improved and self-contained monitoring package. There's no need to use this approach on BeeGFS v7.3.3 and beyond. See th...
Nomad pack for InfluxDB with BeeGFS filesystem
Nomad Pack and Nomad BeeGFS Nomad Pack for InfluxDB on Nomad with BeeGFS Backup \& restore Using influx backup Conclusion
Display per-storage node performance guarantees of SolidFire nodes
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
SolidFire Collector on Kubernetes
What is SFC Making SolidFire Collector work with Kubernetes Appendix: Deploymennt for SFC and Graphite
SolidFire capacity and efficiency report generator
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
hyper-v
SolidFire Extension for Windows Admin Center 2025
Introduction Walk-through And now… Conclusion Appendix A: demo Animated GIF (no playback control) Video demo with voice-over ...
SolidFire Gateway for Windows Admin Center 2025
Introduction What it is What it does IIS Setup Why this matters What about it? Conclusion
Convert NetApp HCI from VMware to Hyper-V
Requirement Workflow Storage considerations Tools
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Two
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Three
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
How to change NetApp HCI from VMware to alternatives
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
sfc
InfluxDB 3 Core Alpha available for testing
Introduction What's backwards compatible and what's not in InfluxDB 3 Evaluate with E-Series Performance Analyzer Other details Conclusion Appen...
Snapshots and snapshot schedules in SFC v2
Introduction
SFC v2 adds volume replication monitoring
What replication monitoring? What does that mean? What can we see? Other implementation details Grafana aside Summary
Monitoring volume replication in NetApp SolidFire
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
SolidFire Collector v2.0.0 is ready
Intro Other objectives What's new in SFC Rewrite Back-end database change Asynchronous execution Drop SolidFire Python SD...
Metrics for NetApp SolidFire backup-to-S3 in InfluxDB and Grafana
Introduction Initiating and monitoring SolidFire backup-to-S3 jobs Initiation Status Progress Completion and result ...
NetApp SolidFire Collector with Grafana 11
You may have heard Grafana 11 is coming out soon.
vmware
VMware license calculator for VVF and VCF
Introduction VMware's calculator (KB 96426) Example for NetApp HCI Conclusion
How to change NetApp HCI from VMware to alternatives
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
Zero-out and rethin VMDKs on NFS
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
Kubernetes with vSphere CSI Plugin and NetApp E-Series
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
Adapter, network and VLAN isolation on NetApp HCI
This comes up every so often:
sizing
EConfig v2
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
DDP capacity splitter for E-Series
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
Brute force sizing NetApp E-Series
Introduction Considerations Create configuration options Choice of query tool Show available options Query capacity range Manual selection of ...
Configuration approaches to NetApp E-Series with ThinkParQ BeeGFS
It may not be easy to digest how BeeGFS with NetApp E-Series is usually configured.
Rightsizing compute resources in the cloud with Spot.io
Most cloud users know about the various options to rent cloud compute resources.
Splunk sizing with shared core HCI vendors
In recent weeks I've done a fair amount of reading about log management solutions, and I have to say the quality of technical material related to Splunk and ...
docker
Containerized BeeGFS with NetApp E-Series
Introduction
Rocky Linux 8 and 9 with NetApp Trident Docker volume plugin and SolidFire 12 iSCSI storage
The official Trident documentation is okay, but it mentions no Rocky Linux.
HashiCorp Nomad CSI with NetApp SolidFire and E-Series back-ends
Introduction NetApp E-Series NetApp BeeGFS CSI Other CSI provisioners and non-CSI approaches NetApp SolidFire Cind...
HashiCorp Nomad with NetApp SolidFire-backed iSCSI volumes
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
GA of NetApp Trident v21.04
What Upgrade procedure Before Out with the old, in with the new Verify success Trident for ARM64 and other non-AMD64 ar...
Use StorageGRID for private container registry
Docker Registry
sync
Use SolidFire API to monitor clone and backup jobs for profit and pleasure
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
Containerized Cloud Sync Data Broker for Docker, Kubernetes and Nomad
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
Using NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Using rclone to copy StorageGRID S3 data to local filesystem
NOTICE: all credentials and tokens on this page are samples, not leaked.
Replicate volume data from Digital Ocean to SolidFire and back
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
audit
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
SGAC v0.2.1
Some two months ago I rewrote SGAC and released it as v0.1.
SolidFire SNMP v3, Telegraf, Prometheus, Grafana
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SGAC v0.1
How it begun
linux
Fix slow PowerShell startup time on Linux due to misconfigured environment
Problem Background Solution(s) Epilogue
Remove password complexity requirements on Ubuntu 24.04 LTS
Busybodies@work I want 123456 Ending Appendix A: recommended low-quality password settings for pwquality.conf
How to change NetApp HCI from VMware to alternatives
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
Azure Linux with SolidFire iSCSI targets
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
Rocky Linux 8 and 9 with NetApp Trident Docker volume plugin and SolidFire 12 iSCSI storage
The official Trident documentation is okay, but it mentions no Rocky Linux.
Flatcar Container Linux with SolidFire iSCSI
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
nomad
NetApp E-Series Performance Analyzer in orchestrated container environments
EPA on Kubernetes and Nomad is here
Speed of volume creation with BeeGFS CSI
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
Simple S3 service endpoint for BeeGFS using Hashicorp Nomad and stand-alone MinIO
I have a small Nomad cluster which can access a BeeGFS filesystem.
Scaling out Nomad batch jobs with BeeGFS and NetApp E-Series
Introduction Setup Scaling-out IO-intensive batch jobs Shared file system vs. file server vs. internal disk Scale-out batch jobs with Nomad I/O an...
Nomad batch jobs with BeeGFS and E-Series
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
HashiCorp Nomad with NetApp SolidFire-backed iSCSI volumes
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
NetApp
Protect multi-volume Kubernetes applications with NetApp Trident and SolidFire
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
Visualize E-Series temperature and power consumption metrics with EPA
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Velero 1.10 with NetApp Trident and SolidFire
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Backup and replicate Kubernetes PVs with SolidFire using VolSync
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
Minimizing ransomware risks for SolidFire data
SolidFire vs. Ransomware
Containerized Cloud Sync Data Broker for Docker, Kubernetes and Nomad
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
SolidFire
Use cases for AWS mountpoint-s3 with NetApp E-Series and SolidFire
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Protect multi-volume Kubernetes applications with NetApp Trident and SolidFire
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
Velero 1.10 with NetApp Trident and SolidFire
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Backup and replicate Kubernetes PVs with SolidFire using VolSync
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Minimizing ransomware risks for SolidFire data
SolidFire vs. Ransomware
ef-series
NetApp E-Series sizing for Splunk 9 with SmartStore
Introduction Existing material Related posts on this blog Observations TB per day Events per day Sizing challenges ...
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Monitor Snapshot Consistency Groups of NetApp E-Series SANtricity OS
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Monitor snapshot and clone repositories of NetApp E-Series SANtricity OS
Problem statement Considerations First iteration Second iteration Conclusion
Benefits of RAID 1 in E-Series DDP
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
Ubuntu 22.04 LTS as iSER client to NetApp E-Series
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
rancher
Backup Rancher cluster configuration to NetApp StorageGRID
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Get Rancher Kubernetes deployment log for on NetApp HCI mNode
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Rancher Kubernetes Layer-7 NLB/Ingress with NGINX Plus and Let's Encrypt
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Deploying Rancher Worker VMs to NetApp HCI with VMware VSS
Earlier this week I spotted the advice to not select a VM host when deploying Rancher worker VMs to a vSphere environment where DRS is enabled, because "DRS ...
solid-rancher
solid-rancher is a Github repo I created to organize and enrich information related to Rancher on SolidFire (and NetApp HCI in general).
hcc
Check Active IQ connectivity from HCC on SolidFire mNode
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
Using NetApp SolidFire Hybrid Cloud Control (HCC) API from PowerShell
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire Maintenance Mode
Maintenance Mode is a relatively new SolidFire feature that takes a node in and out of the neutral. In other words, it nicely moves a node's services to rema...
Get NetApp Hybrid Cloud Control logs via the HCC API
Hybrid Cloud Control (HCC) is a group of services - management plane, if you will - for out-of-band management of NetApp HCI, SolidFire and eSDS. Currently i...
SolidFire mNode and HCC Log Fowarding
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
kasten
The new Kasten K10 v5.0 with NetApp SolidFire
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
Logical backup vs. storage-assisted backup with Kasten v4 and SolidFire 12
To answer the question quickly: logical backups make sense.
Kubernetes data protection and storage management with NetApp SolidFire and Kasten K10
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
StorageGRID as Cloud Storage (S3) Provider for Kasten K10
Previously I blogged about using Kasten with NetApp HCI and SolidFire, but I did not have time to examine another NetApp storage integration, namely that of ...
Protect your Kubernetes with Kasten and SolidFire
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
networking
NetApp StorageGRID networks
Introduction
SolidFire Backup to S3 over Storage Network
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
Data Path in SolidFire clusters with Protection Domains
In the post that compares SolidFire Protection Domains with Availability Zones I had this illustration of network connectivity among SolidFire v12 cluster no...
Role of SolidFire networks in SolidFire storage replication
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
Adapter, network and VLAN isolation on NetApp HCI
This comes up every so often:
vsphere
Convert NetApp HCI from VMware to Hyper-V
Requirement Workflow Storage considerations Tools
Zero-out and rethin VMDKs on NFS
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
Kubernetes with vSphere CSI Plugin and NetApp E-Series
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
Adapter, network and VLAN isolation on NetApp HCI
This comes up every so often:
splunk
NetApp E-Series sizing for Splunk 9 with SmartStore
Introduction Existing material Related posts on this blog Observations TB per day Events per day Sizing challenges ...
Splunk sizing with shared core HCI vendors
In recent weeks I've done a fair amount of reading about log management solutions, and I have to say the quality of technical material related to Splunk and ...
Virtualized StorageGRID for Splunk Smartstore on NetApp HCI and EF-Series array
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
Virtualized Splunk on NetApp HCI and EF Series iSCSI storage
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
database
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 vector search - DIY vs AWS S3 Vectors
This is a two-part post:
Oracle TimesTen Classic XE notes
Oracle TimesTen XE Classic v22.1 has quite a few requirements and settings related to memory and storage. Some attributes directly and indirectly related to ...
Cassandra with SolidFire and E-Series
Introduction
NetApp StorageGRID for Vertica EON Mode
WTF is EON Mode What do I need to do to get Vertica EON Mode work with StorageGRID TLS certificate for HTTPS IP address for S3 API endp...
ddp
EConfig v2
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
Benefits of RAID 1 in E-Series DDP
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
DDP capacity splitter for E-Series
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
New Dynamic Disk Pool configuration and E-Series SANtricity
Dynamic Disk Pools vs. Disk Groups New DDP configuration What does that mean? Things to note SANtricity Web Services Proxy Web Proxy Container ...
Faster initialization and rebalancing with Dynamic Disk Pools on NetApp E-Series
RAID 6 vs DDP DDP expansion Disk media refresh with DDP pools Demo
redhat
Boot OpenShift RCOS from NetApp SolidFire iSCSI target
Introduction How Other SolidFire-related tips Conclusion
SolidFire Operator for Kubernetes
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
SolidFire RBAC workflow with Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
Red Hat Quay with NetApp ONTAP S3
NOTICE: all credentials and tokens on this page are samples, not leaked.
Red Hat Quay with NetApp StorageGRID S3 Back End
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
observability
Analyze HTTP logs from NetApp StorageGRID gateway nodes
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
Event monitoring with SNMP trap notifications from NetApp E-Series arrays
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
Elasticsearch performance with E-Series
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
ontap s3
Teradata Vantage with NetApp S3 object stores
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
Microsoft SQL Server data virtualization PolyBase with S3 Object Stores
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
SolidFire backup-to-S3 using ONTAP S3 destination
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
Evaluating ONTAP S3 performance with s3tester
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
Red Hat Quay with NetApp ONTAP S3
NOTICE: all credentials and tokens on this page are samples, not leaked.
proxmox
Firemox - an anti-plugin for Proxmox PVE with NetApp SolidFire
Background Firemox What it does, and doesn't (Stopping) scope creep Known issues and limitations Conclusion Demo and source c...
Do we need a NetApp SolidFire plugin for Proxmox
Who wants it and why? Perl for the win! Features Effort Appendix A: what works and how Appendix B: observations, problems, solutions Appendix ...
Add NetApp SolidFire iSCSI storage to KVM
Introduction Storage options exposed in Virtual Manager Filesystem directory Physical disk device Preformatted block device ...
How to change NetApp HCI from VMware to alternatives
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
Consume SolidFire storage from Proxmox hosts
Configure Proxmox 7.1 with SolidFire 12.3 SolidFire Demo VM on Proxmox
efficiency
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
ZFS deduplication with NetApp E-Series
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
Zero-out and rethin VMDKs on NFS
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
Low-hanging BeeGFS efficiency fruit
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
Storage efficiency with Kafka 3.2 and NetApp SolidFire 12
Objective How I tested Kafka tests and results Random ASCII records StorageGRID audit log Protecting Kafka on a single site...
search
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 vector search - DIY vs AWS S3 Vectors
This is a two-part post:
StorageGRID and Elasticsearches
Why "Elasticsearches"?
Milvus with SolidFire and E-Series
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
instaclustr
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
Kafka notifications in NetApp StorageGRID 11.8
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Postgres, pgvector, E-Series and Instaclustr
NOTICE: all credentials and tokens on this page are samples, not leaked.
Burst on-prem GPU workloads from BeeGFS/E-Series clusters to Spot Ocean for Spark in the cloud
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
On-prem Spot Instaclustr-managed clusters with NetApp E-Series storage
Introduction Compute layer and storage interconnect Small and large clusters HDDs, SSDs, RAID, DDP… How to automate E-Series volume provisioning t...
Kubernetes
Backup and replicate Kubernetes PVs with SolidFire using VolSync
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Backup/restore E-Series Performance Analyzer with Kasten K10
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Store Kasten backups on NetApp E-Series
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
Containerized Cloud Sync Data Broker for Docker, Kubernetes and Nomad
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
E-Series
Use cases for AWS mountpoint-s3 with NetApp E-Series and SolidFire
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
Elasticsearch performance with E-Series
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Visualize E-Series temperature and power consumption metrics with EPA
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
Backup/restore E-Series Performance Analyzer with Kasten K10
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Store Kasten backups on NetApp E-Series
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
versity
SolidFire backup to disk with Versity S3 Gateway
This is more appropriate for a tweet, but anyway…
Data pipeline with BeeGFS FS Event Notifications and Versity S3 Gateway
Background Why this is cool Catches File/object duality considerations Conclusion Demo
MinIO and Versity S3 GW with tiny object workloads on NetApp E-Series
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
Versity S3 Gateway with BeeGFS
What Config How Using Conclusion Appendix - External performance test
Versity S3 Gateway
What
clone
Using NetApp E-Series Volume Copy
What is a volume created by Volume Copy operation How does it work? Progress Reserve size Reserve location Priority Automating Volume Copy A...
Monitor Snapshot Consistency Groups of NetApp E-Series SANtricity OS
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Monitor snapshot and clone repositories of NetApp E-Series SANtricity OS
Problem statement Considerations First iteration Second iteration Conclusion
Stand-alone and Consistency Group snapshots on NetApp E-Series
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Use SolidFire API to monitor clone and backup jobs for profit and pleasure
Problem API methods Finding SolidFire API limits Clone jobs Slice sync jobs Clone sync jobs Remo...
zfs
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Ubuntu 24.04 LTS with NetApp SolidFire
Introduction Create, discover, login Efficiency - zpools on SoliFire vs global SolidFire efficiencies Comparison with XFS and BTRFS ...
ZFS with NetApp E-Series
Introduction What is E-Series anyway Easy storage management Conclusion
ZFS deduplication with NetApp E-Series
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
Block volume mode in Kubernetes with SolidFire
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
netapp storagegrid
Filesystem block size used by NetApp StorageGRID
So, what filesystem block size does StorageGRID 11.8 use?
Analyze HTTP logs from NetApp StorageGRID gateway nodes
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Kafka notifications in NetApp StorageGRID 11.8
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Delete old object versions on NetApp StorageGRID
Introduction
NetApp StorageGRID on VMware
Introduction Network Servers StorageGRID load balancer OS Storage Flash tier NL-SAS tier DDP vs RAID Gro...
terraform
Updated Terraform provider for SolidFire
Introduction What's new in 2025 Next steps
Create and maintain SolidFire volumes and accounts with Terraform
NOTICE: all credentials and tokens on this page are samples, not leaked.
Using Terraform 1.0.6 with SolidFire 12.3
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire Provider for Terraform
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
logging
Gathering and forwarding E-Series SANtricity Major Event Log (MEL)
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
Forward E-Series SANtricity logs to remote syslog server
Configure SANtricity to send array events to a remote syslog server
Elasticsearch 8 with NetApp storage
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidFire mNode and HCC Log Fowarding
SolidFire Management Node (aka mNode) is a VM that runs Hybrid Cloud Services (various "management stuff".) Let's say we wanted to collect and analyze those ...
restic
Velero 1.10 with NetApp Trident and SolidFire
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
Rest Server with NetApp E-Series
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
Velero V1.8 with Restic, SolidFire 12.3 and StorageGRID 11.5
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidBackup with alternative backup clients
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
kopia
Velero 1.12 and CSI Snapshot Data Movement with NetApp SolidFire
Introduction WTF is CSI Snapshot Data Movement (CSI SDM) Why is that a Good Thing Get ready to use CSI SDM with NetApp Astra Triden...
SolidBackup with Kopia
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
Velero 1.10 with NetApp Trident and SolidFire
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
SolidBackup with alternative backup clients
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
snmp
Monitoring NetApp E-Series with PRTG
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
Configure SNMP on SolidFire cluster using Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
SolidFire SNMP v3, Telegraf, Prometheus, Grafana
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
Monitor SolidFire with SNMP
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
ilm
Delete old object versions on NetApp StorageGRID
Introduction
Snapshots and ILM with Elasticsearch 8
Introduction Elasticsearch "snapshots" Snapshot to S3 vs. snapshot to Path Multiple repositories Backup performance Ela...
How to create StorageGRID object path-based ILM rule
Say you have a bucket called junk with "directory tree" (not really but…) several levels deep (junk/lev1/lev2) and want to do some ILM stuff on the stuff in ...
hadoop
Cloudera Base with NetApp E-Series
Introduction Reference architectures High-level design and best practices What's new in Cloudera Base Deployment topology Sizin...
Apache Hadoop 3 with NetApp E-Series
HDFS Durability and External Protected Storage Does everyone need RF2 HDFS Erasure Coding Compression NFS gateway Snapsho...
caching
SSD Cache feature on NetApp SANtricity E-Series
WTH is "SSD Cache" Create SSD cache Configure HDD-based volumes to use SSD Cache Summary API for monitoring
hashicorp
Speed of volume creation with BeeGFS CSI
While reading the excellent article Why We Migrated from Kubernetes to Nomad (2021) it occurred to me I spotted some of the same advantages while working on ...
Simple S3 service endpoint for BeeGFS using Hashicorp Nomad and stand-alone MinIO
I have a small Nomad cluster which can access a BeeGFS filesystem.
Nomad batch jobs with BeeGFS and E-Series
Introduction Setup Generic batch job with I/O to parallel filesystem File format conversion Summary Demo
HashiCorp Nomad with NetApp SolidFire-backed iSCSI volumes
Introduction Deploy Nomad with SolidFire Host Volumes Backup and restore Backup data from VM with SolidFire-based as Host Volumes Bac...
k8s
Backup and replicate Kubernetes PVs with SolidFire using VolSync
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Backup/restore E-Series Performance Analyzer with Kasten K10
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Store Kasten backups on NetApp E-Series
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
consistency group
The shocking truth about SolidFire ModifySchedule method
Introduction Show me Why? Thoughts Conclusion
Monitor Snapshot Consistency Groups of NetApp E-Series SANtricity OS
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Stand-alone and Consistency Group snapshots on NetApp E-Series
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
Using snapshot attributes in SolidFire
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
vector
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 vector search - DIY vs AWS S3 Vectors
This is a two-part post:
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
Postgres, pgvector, E-Series and Instaclustr
NOTICE: all credentials and tokens on this page are samples, not leaked.
netapp hci
Convert NetApp HCI from VMware to Hyper-V
Requirement Workflow Storage considerations Tools
VMware license calculator for VVF and VCF
Introduction VMware's calculator (KB 96426) Example for NetApp HCI Conclusion
Add NetApp SolidFire iSCSI storage to KVM
Introduction Storage options exposed in Virtual Manager Filesystem directory Physical disk device Preformatted block device ...
How to change NetApp HCI from VMware to alternatives
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
provider
Create and maintain SolidFire volumes and accounts with Terraform
NOTICE: all credentials and tokens on this page are samples, not leaked.
Using Terraform 1.0.6 with SolidFire 12.3
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
SolidFire Provider for Terraform
The Provider is now available from the official Terraform registry. This means we no longer need to download and build it manually. It is also easy to use it...
nginx
Rancher Kubernetes Layer-7 NLB/Ingress with NGINX Plus and Let's Encrypt
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
kanister
The new Kasten K10 v5.0 with NetApp SolidFire
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
Backup and restore NetApp BeeGFS CSI PVs with Kanister
Introduction What Kanister does Summary Demo
Protect your Kubernetes with Kasten and SolidFire
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
registry
Red Hat Quay with NetApp ONTAP S3
NOTICE: all credentials and tokens on this page are samples, not leaked.
Red Hat Quay with NetApp StorageGRID S3 Back End
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
Use StorageGRID for private container registry
Docker Registry
container registry
Red Hat Quay with NetApp ONTAP S3
NOTICE: all credentials and tokens on this page are samples, not leaked.
Red Hat Quay with NetApp StorageGRID S3 Back End
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
Use StorageGRID for private container registry
Docker Registry
hcicollector
NetApp SolidFire Collector with Grafana 11
You may have heard Grafana 11 is coming out soon.
Hardware monitoring of NetApp HCI compute nodes for dark sites
NetApp HCI compute nodes are normally monitored from mNode, which is a VM that fetches events from both storage and compute nodes.
Announcing HCICollector v0.7
What's new in HCICollector v0.7 Improvements Setbacks What's next for HCICollector Unsolvable NetApp Trident Download HCI...
dr
Extract SolidFire volume attributes created by Trident or other apps
This series of posts has several parts:
Increase size of SolidFire volumes paired for replication
Introduction Situation Procedure Kubernetes Conclusion Appendix A - upsize remote and resize in Longhorny
Kubernetes failover and failback with Trident CSI and SolidFire
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
cloudsync
Using NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Getting started with NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
cloud sync
Using NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
Getting started with NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
security
SBOM with signed Apptainer containers on BeeGFS
Introduction Why Build data-app container and check its inventory Use it Conclusion
SolidFire and CVE-2021-44228 Apache Log4j Vulnerability
If you haven't enabled VVOLs on SolidFire (Element, eSDS), i.e. VASA service hasn't been enabled, there's no need to do anything.
Storage account-level vs. IQN-level CHAP on SolidFire
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
alluxio
ram cache
ansible
SolidFire Operator for Kubernetes
solidfire-operator is a Proof-of-Concept operator for Kubernetes built using Operator Framework.
SolidFire RBAC workflow with Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
Configure SNMP on SolidFire cluster using Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
parquet
Teradata Vantage with NetApp S3 object stores
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
Microsoft SQL Server data virtualization PolyBase with S3 Object Stores
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
S3 Select vs. remote SQL access to CSV over FUSE
In a recent post I wrote about S3 Select in StorageGRID 11.6.
spot.io
Burst on-prem GPU workloads from BeeGFS/E-Series clusters to Spot Ocean for Spark in the cloud
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
On-prem Spot Instaclustr-managed clusters with NetApp E-Series storage
Introduction Compute layer and storage interconnect Small and large clusters HDDs, SSDs, RAID, DDP… How to automate E-Series volume provisioning t...
Rightsizing compute resources in the cloud with Spot.io
Most cloud users know about the various options to rent cloud compute resources.
kafka
Kafka notifications in NetApp StorageGRID 11.8
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Storage efficiency with Kafka 3.2 and NetApp SolidFire 12
Objective How I tested Kafka tests and results Random ASCII records StorageGRID audit log Protecting Kafka on a single site...
E-Series as Tier One for multi-tiered Kafka clusters
Multi-tiered storage in Kafka clusters How to leverage E-Series Performance vs. data protection overhead Sequential performance vs. lat...
capacity
EConfig v2
WTF is EConfig? What's new How I use EConfig DDP BeeGFS Troubles Conclusion Appendix A - BeeGFS sizer
DDP capacity splitter for E-Series
NOTE: the Web site with this tool was improved and updated on 2024/04/19, so some details below may differ from current functionality
Brute force sizing NetApp E-Series
Introduction Considerations Create configuration options Choice of query tool Show available options Query capacity range Manual selection of ...
compression
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
NetApp SolidFire backup to S3 and MinIO compression savings
Introduction SolidFire backup to S3 MinIO compression Results Conclusions
Low-hanging BeeGFS efficiency fruit
Following my previous post on TensorStore with BeeGFS I thought I should revisit another item from my lengthy to-do list: filesystem compression.
hybrid cloud
Burst on-prem GPU workloads from BeeGFS/E-Series clusters to Spot Ocean for Spark in the cloud
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
On-prem Spot Instaclustr-managed clusters with NetApp E-Series storage
Introduction Compute layer and storage interconnect Small and large clusters HDDs, SSDs, RAID, DDP… How to automate E-Series volume provisioning t...
Hybrid cloud scenarios with Cloudflare serverless
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
DevOps
Using snapshot attributes in SolidFire
Snapshot attributes in SolidFire Hashtable example Snapshot with attributes Using snapshot attributes Conclusion
Like Flask, but with PowerShell
PowerShell (still) rocks PowerShell-based services Some ideas and use cases De-skill Kubernetes operations Provide RBAC to PowerShell...
ransomware
Scan NetApp StorageGRID S3 buckets for viruses and malware
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
Minimizing ransomware risks for SolidFire data
SolidFire vs. Ransomware
Minimizing ransomware risks for SolidFire data
SolidFire vs. Ransomware
Kasten
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Backup/restore E-Series Performance Analyzer with Kasten K10
Introduction Backup Customizing backup scripts Restore Scenario 1: delete deployments, PVCs and PVs, restore from reposi...
Store Kasten backups on NetApp E-Series
Backup repository choices for Kasten with E-Series Veeam Repository S3 bucket NFS share Which one to use? Cost and performance Se...
gateway
Analyze HTTP logs from NetApp StorageGRID gateway nodes
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Versity S3 Gateway with BeeGFS
What Config How Using Conclusion Appendix - External performance test
Versity S3 Gateway
What
version
Analyze HTTP logs from NetApp StorageGRID gateway nodes
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
Delete old object versions on NetApp StorageGRID
Introduction
object store
Velero AWS Plugin and SignatureDoesNotMatch nonsense
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
Use ONTAP S3 as backup destination for Velero
Update (2024/06): I haven't tested this yet, but it seems after Velero AWS Plugin v1.9, ONTAP S3 users can no longer use Velero. One workaround for this is t...
indexing
Simple file share and S3 analytics and MCP ops
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
sql server
Windows Server 2025 with NetApp SolidFire 12 iSCSI Part Two
This is the second of the posts posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Windows Server 2025 with NetApp SolidFire 12 iSCSI
This is the first of possibly several posts on Microsoft Windows Server 2025 and NetApp SolidFire.
Microsoft SQL Server data virtualization PolyBase with S3 Object Stores
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
data
SolidBackup with Kopia
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
Use Simple Backups to file-backup cloned SolidFire volumes to S3/B2
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
Using synthetic SolidFire S3 backups for Dev/Test purposes
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
embedding
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 vector search - DIY vs AWS S3 Vectors
This is a two-part post:
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
rag
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
OPEA AI with NetApp E-Series
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
qos
Make use of storage QoS histograms on NetApp SolidFire
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
Set Temporary Storage QoS Policy for SolidFire Volume
Say we have a Volume ID 321 with a storage QoS Policy ID 5, and need to run a temporary job that would benefit from a different Storage QoS Policy (higher or...
fc
Rocky Linux 8 and 9 added to NetApp E-Series interoperability matrix
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
How much slower is iSCSI vs. Fibre Channel
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
benchmark
Evaluating ONTAP S3 performance with s3tester
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
DiskSpd performance from NetApp HCI VM to EF280
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
veeam
NetApp E-Series DAS or SAN storage as Veeam Hardened Repository
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
DiskSpd performance from NetApp HCI VM to EF280
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
vm
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
Virtualized Splunk on NetApp HCI and EF Series iSCSI storage
Things are getting interesting Does EF-Series for Splunk on NetApp HCI make sense How does it work How does that compare with other HCI C...
smartstore
NetApp E-Series sizing for Splunk 9 with SmartStore
Introduction Existing material Related posts on this blog Observations TB per day Events per day Sizing challenges ...
Virtualized StorageGRID for Splunk Smartstore on NetApp HCI and EF-Series array
If you'd like to deploy Splunk SmartStore with NetApp StorageGRID object storage but also want to "start small", you can consider using smaller StorageGRID a...
PowerShell
Like Flask, but with PowerShell
PowerShell (still) rocks PowerShell-based services Some ideas and use cases De-skill Kubernetes operations Provide RBAC to PowerShell...
Use SolidFire PowerShell Tools to find low efficiency volumes
NetApp Hybrid Cloud Control (HCC) lets you access volume details to a slightly greater detail than the SolidFire Web UI. One additional detail that we are in...
duplicati
SolidBackup with alternative backup clients
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
SolidFire, KVM, Duplicati and S3 Object Storage
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
kvm
Add NetApp SolidFire iSCSI storage to KVM
Introduction Storage options exposed in Virtual Manager Filesystem directory Physical disk device Preformatted block device ...
SolidFire, KVM, Duplicati and S3 Object Storage
In the previous post I explained how SolidFire's built-in backup/restore to/from S3 works and how we can automate it. This post is about doing less automatio...
management
RBAC and delegation for SolidFire JSON-RPC API with Lua
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
Role of SolidFire networks in SolidFire storage replication
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
rclone
Copy StorageGRID objects and tags using rclone
Create two buckets, source and destination, a PUT a test object with some junk tags to source/.
SolidBackup with alternative backup clients
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
go
Create and maintain SolidFire volumes and accounts with Terraform
NOTICE: all credentials and tokens on this page are samples, not leaked.
Using Terraform 1.0.6 with SolidFire 12.3
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
quay
Red Hat Quay with NetApp ONTAP S3
NOTICE: all credentials and tokens on this page are samples, not leaked.
Red Hat Quay with NetApp StorageGRID S3 Back End
Create a bucket, say quay, and a set of S3 keys for one of your S3 users to use with this bucket.
hdfs
Apache Hadoop 3 with NetApp E-Series
HDFS Durability and External Protected Storage Does everyone need RF2 HDFS Erasure Coding Compression NFS gateway Snapsho...
cloud
Postgres, pgvector, E-Series and Instaclustr
NOTICE: all credentials and tokens on this page are samples, not leaked.
Getting started with NetApp Cloud Sync API
NOTICE: all credentials and tokens on this page are samples, not leaked.
rbac
RBAC and delegation for SolidFire JSON-RPC API with Lua
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
SolidFire RBAC workflow with Ansible
NOTICE: all credentials and tokens on this page are samples, not leaked.
data management
SolidFire backup-to-S3 with Backblaze
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
The new Kasten K10 v5.0 with NetApp SolidFire
Kubernetes-native RBAC S3 Object Lock support "Officialized" (Kanister) blueprints for SQL Server and PostgreSQL Operator aka PGO OpenStack and vSph...
xcp-ng
How to change NetApp HCI from VMware to alternatives
Introduction Challenges with vSphere 8 on NetApp HCI Alternatives NetApp HCI storage and data migration Summary Appendix A - VirtualBox Append...
XCP-ng and XOA with NetApp SolidFire iSCSI Storage Repositories
Introduction XCP-NG with SolidFire XOA Conclusion
apptainer
SBOM with signed Apptainer containers on BeeGFS
Introduction Why Build data-app container and check its inventory Use it Conclusion
Apptainer with BeeGFS
Apptainer is based on the Singularity project.
rocky linux
Rocky Linux 8 and 9 added to NetApp E-Series interoperability matrix
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
Rocky Linux 8 and 9 with NetApp Trident Docker volume plugin and SolidFire 12 iSCSI storage
The official Trident documentation is okay, but it mentions no Rocky Linux.
rocky
Rocky Linux 8 and 9 added to NetApp E-Series interoperability matrix
Rocky Linux 8 and 9 have been added to the NetApp E-Series interoperability matrix starting with SANtricity 11.70.
Rocky Linux 8 and 9 with NetApp Trident Docker volume plugin and SolidFire 12 iSCSI storage
The official Trident documentation is okay, but it mentions no Rocky Linux.
lxd
ZFS with NetApp E-Series
Introduction What is E-Series anyway Easy storage management Conclusion
LXD containers and VMs on BeeGFS with NetApp E-Series
Introduction Why LXD on BeeGFS (with or without NetApp E-Series) Get started Optimal BeeGFS settings HA BeeGFS client in LXD VMs on LXD server a...
password
Remove password complexity requirements on Ubuntu 24.04 LTS
Busybodies@work I want 123456 Ending Appendix A: recommended low-quality password settings for pwquality.conf
PowerShell password change script for local user account on E-Series SANtricity OS
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
syslog
StorageGRID and Elasticsearches
Why "Elasticsearches"?
Forward E-Series SANtricity logs to remote syslog server
Configure SANtricity to send array events to a remote syslog server
event
Kafka notifications in NetApp StorageGRID 11.8
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
Gathering and forwarding E-Series SANtricity Major Event Log (MEL)
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
ssd
SSD Cache feature on NetApp SANtricity E-Series
WTH is "SSD Cache" Create SSD cache Configure HDD-based volumes to use SSD Cache Summary API for monitoring
SSD disk wear indicator in E-Series SANtricity 11.70
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
wear
Monitor wear level of NetApp E-Series flash drives via the API and from the CLI
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
SSD disk wear indicator in E-Series SANtricity 11.70
E-Series SANtricity 11.70 shows wear level for SSD/NVMe disks.
flash
Flash media overprovisioning on NetApp E-Series
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
Monitor wear level of NetApp E-Series flash drives via the API and from the CLI
At some point (I couldn't find the exact release in the documentation, but I've found it v11.52) E-Series Engineering added SSD wear level metrics to the SAN...
Cloud Sync
Use Cloud Sync API and Elasticsearch to improve data replication
Why and when automate Cloud Sync?
Containerized Cloud Sync Data Broker for Docker, Kubernetes and Nomad
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
CloudSync
Use Cloud Sync API and Elasticsearch to improve data replication
Why and when automate Cloud Sync?
Containerized Cloud Sync Data Broker for Docker, Kubernetes and Nomad
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
ELK
Elasticsearch performance with E-Series
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Use Cloud Sync API and Elasticsearch to improve data replication
Why and when automate Cloud Sync?
Trident
Backup and replicate Kubernetes PVs with SolidFire using VolSync
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
CSI
Protect multi-volume Kubernetes applications with NetApp Trident and SolidFire
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
Velero 1.10 with NetApp Trident and SolidFire
Velero 1.10 came out recently so I tried it with Kubernetes v1.26.1, Trident v23.01, and SolidFire 12.5.
unmap
UNMAP/TRIM Hyper-V volumes backed by NetApp SolidFire
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
Zero-out and rethin VMDKs on NFS
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
rethin
UNMAP/TRIM Hyper-V volumes backed by NetApp SolidFire
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
Zero-out and rethin VMDKs on NFS
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
logstash
Analyze HTTP logs from NetApp StorageGRID gateway nodes
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
StorageGRID and Elasticsearches
Why "Elasticsearches"?
versioning
Delete old object versions on NetApp StorageGRID
Introduction
compliance
ec
MinIO Erasure Coding with NetApp E-Series
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
erasure coding
MinIO Erasure Coding with NetApp E-Series
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
b2
SolidBackup with Kopia
Objectives and tools Steps to set up backup with Kopia Steps on OS and SolidBackup Steps related to Kopia Ensuring SolidBackup an...
SolidFire backup-to-S3 with Backblaze
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
versitygw
MinIO and Versity S3 GW with tiny object workloads on NetApp E-Series
Introduction The problem Solutions Notes on MinIO Notes on VersityGW Benchmarking and testing VersityGW on scale-out file systems vs ...
Versity S3 Gateway with BeeGFS
What Config How Using Conclusion Appendix - External performance test
snapshot volume
Monitor Snapshot Consistency Groups of NetApp E-Series SANtricity OS
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Monitor snapshot and clone repositories of NetApp E-Series SANtricity OS
Problem statement Considerations First iteration Second iteration Conclusion
snapshot image
Monitor Snapshot Consistency Groups of NetApp E-Series SANtricity OS
Problem statement Considerations SANtricity UI Consistency Group Sensor for PRTG What's missing but would be nice to have Conclusion
Monitor snapshot and clone repositories of NetApp E-Series SANtricity OS
Problem statement Considerations First iteration Second iteration Conclusion
postgresql
Postgres, pgvector, E-Series and Instaclustr
NOTICE: all credentials and tokens on this page are samples, not leaked.
Faster PostgreSQL with DDP-based RAID 1 compared to DDP-based RAID 6
Introduction Environment Tests Results Other performance views Conclusion
ubuntu
Remove password complexity requirements on Ubuntu 24.04 LTS
Busybodies@work I want 123456 Ending Appendix A: recommended low-quality password settings for pwquality.conf
Ubuntu 24.04 LTS with NetApp SolidFire
Introduction Create, discover, login Efficiency - zpools on SoliFire vs global SolidFire efficiencies Comparison with XFS and BTRFS ...
hooks
Use Velero with NetApp Verda and Trident CSI
What is Verda Example with Redis Conclusion
Velero v1.13 metadata, hooks with NetApp Trident v24.02
Introduction Backup detail enhancements in Velero v1.13 Mapping Velero jobs to SolidFire volume and snapshot objects How many Veler...
swagger
Swagger files for NetApp E-Series
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
OpenAPI and SolidFire
SolidFire doesn't have an OpenAPI interface. See here.
openapi
Swagger files for NetApp E-Series
If you want to develop or automate E-Series but aren't always connected, you may want to work offline with Swagger API files.
OpenAPI and SolidFire
SolidFire doesn't have an OpenAPI interface. See here.
longhorny
Monitoring volume replication in NetApp SolidFire
Introduction SolidFire volume replication Failed and not-so-successful approaches Write workload at destination Node throughput ...
mcp
Simple file share and S3 analytics and MCP ops
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
Build NetApp SolidFire MCP server
Introduction MCP Use cases? Get, set, and security Conclusion Additional reading
pipeline
Data pipeline with BeeGFS FS Event Notifications and Versity S3 Gateway
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Improved pipelines with BeeGFS FS Event Notifications in v8
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
clamav
Data pipeline with BeeGFS FS Event Notifications and Versity S3 Gateway
Background Why this is cool Catches File/object duality considerations Conclusion Demo
Improved pipelines with BeeGFS FS Event Notifications in v8
Introduction What's new in BeeGFS file-system events in BeeGFS v8 Dude, where's my gRPC server? Can BeeGFS watch server, erhm, client, ...
knn
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 vector search - DIY vs AWS S3 Vectors
This is a two-part post:
similarity
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 vector search - DIY vs AWS S3 Vectors
This is a two-part post:
s3 vectors
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
S3 vector search - DIY vs AWS S3 Vectors
This is a two-part post:
windows admin center
SolidFire Extension for Windows Admin Center 2025
Introduction Walk-through And now… Conclusion Appendix A: demo Animated GIF (no playback control) Video demo with voice-over ...
SolidFire Gateway for Windows Admin Center 2025
Introduction What it is What it does IIS Setup Why this matters What about it? Conclusion
github
Muddying the gh-pages waters
I've done my fair share of googling and was surprised to see there are so many complex ways to use Github pages.
dark mode
Dark Mode for NetApp HCI and SolidFire
NetApp HCI, SolidFire, eSDS Web UI
certificate
Helpful waste of time
Introduction Update 1 (2023/08/30) Update 2 (2025/05/03) Update 3 (2025/06/07) FAQs
postman
Helpful waste of time
Introduction Update 1 (2023/08/30) Update 2 (2025/05/03) Update 3 (2025/06/07) FAQs
fibre channel
How much slower is iSCSI vs. Fibre Channel
If you search for "iSCSI vs FC performance" it's not easy to find a recent like-for-like comparison from enterprise vendors. I've been puzzled by this and I ...
f5
Rancher Kubernetes Layer-7 NLB/Ingress with NGINX Plus and Let's Encrypt
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
ingress
Rancher Kubernetes Layer-7 NLB/Ingress with NGINX Plus and Let's Encrypt
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
k10
Protect your Kubernetes with Kasten and SolidFire
Rancher and other Kubernetes users want to protect their applications and data. NetApp HCI and its underlying SolidFire storage are used by NetApp Trident to...
vlan
Adapter, network and VLAN isolation on NetApp HCI
This comes up every so often:
diskspd
DiskSpd performance from NetApp HCI VM to EF280
Summary Why test EF280 performance from a VM VMFS vs. Raw Devices Manageability and iSCSI Cost of an All Flash backup tier ...
object versioning
StorageGRID object versioning
"There's no documentation" is different from "there are no copy-paste examples".
nutanix
Splunk sizing with shared core HCI vendors
In recent weeks I've done a fair amount of reading about log management solutions, and I have to say the quality of technical material related to Splunk and ...
cloud backup service
NetApp HCI with Cloud Backup Service
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
cloud backup
NetApp HCI with Cloud Backup Service
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
cbs
NetApp HCI with Cloud Backup Service
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
ontap select
NetApp HCI with Cloud Backup Service
NetApp Cloud Backup Service backs up your ONTAP data to your Object Storage bucket located in the cloud (Amazon, Azure, Google Cloud).
helm
Install NetApp Trident v21.01.01 with Helm v3 and configure a SolidFire back-end
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
storage efficiency
Use SolidFire PowerShell Tools to find low efficiency volumes
NetApp Hybrid Cloud Control (HCC) lets you access volume details to a slightly greater detail than the SolidFire Web UI. One additional detail that we are in...
vertica
NetApp StorageGRID for Vertica EON Mode
WTF is EON Mode What do I need to do to get Vertica EON Mode work with StorageGRID TLS certificate for HTTPS IP address for S3 API endp...
exporter
Get started with solidfire-exporter
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
solidfire-exporter
Get started with solidfire-exporter
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
bc
Kubernetes failover and failback with Trident CSI and SolidFire
UPDATE Summary Introduction Comparison between PV Patching and Trident Volume Import approach Why only Scena...
edge
Testing Edge-to-DC using Photon IoT and ONTAP
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
photon iot
Testing Edge-to-DC using Photon IoT and ONTAP
Introduction What does it do Storing and protecting your IoT data Object Stores for Photon IoT C2C (Cloud to Container) How to process IoT data up...
cloud mirror
Back to top ↑mirantis
Mirantis Kubernetes Engine 3.4 with NetApp SolidFire 12.2
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
ha
Does SolidFire support Availability Zones
SolidFire Double Helix
az
Does SolidFire support Availability Zones
SolidFire Double Helix
pd
Does SolidFire support Availability Zones
SolidFire Double Helix
protection domain
Does SolidFire support Availability Zones
SolidFire Double Helix
failure domain
Does SolidFire support Availability Zones
SolidFire Double Helix
mvip
Role of SolidFire networks in SolidFire storage replication
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
svip
Role of SolidFire networks in SolidFire storage replication
Everyone should get the hard-to-find TR-4741 (NetApp Element Software Remote Replication), but to answer the simple question: "all of the above".
duplicacy
SolidBackup with alternative backup clients
As I mentioned in one of previous posts on the topic of SolidBackup, we first use SolidSync to sync SolidFire Source volume(s) to Clone volume(s), and then S...
onecollect
Improve SolidFire Support Bundle Log Generation and Upload with Automation and OneCollect
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
chap
Storage account-level vs. IQN-level CHAP on SolidFire
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
iqn
Storage account-level vs. IQN-level CHAP on SolidFire
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
alerting
Monitor SolidFire with SNMP
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
telegraf
SolidFire SNMP v3, Telegraf, Prometheus, Grafana
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
sgac
SGAC v0.2.1
Some two months ago I rewrote SGAC and released it as v0.1.
insight
SolidFire highlights from NetApp INSIGHT 2021
In the case you missed NetApp INSIGHT 2021 and want to catch up with latest SolidFire developments, I recommend to consider some of the following sessions.
cache
Back to top ↑digital ocean
Replicate volume data from Digital Ocean to SolidFire and back
Digital Ocean is a no-nonsense cloud provider that you've probably heard of.
flatcar
Flatcar Container Linux with SolidFire iSCSI
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
coreos
Flatcar Container Linux with SolidFire iSCSI
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
servicenow
Integrate SolidFire with ServiceNow
This is speculative and I haven't tried it, but it looks very interesting.
rsync
Using rclone to copy StorageGRID S3 data to local filesystem
NOTICE: all credentials and tokens on this page are samples, not leaked.
nextcloud
Back to top ↑cve
SolidFire and CVE-2021-44228 Apache Log4j Vulnerability
If you haven't enabled VVOLs on SolidFire (Element, eSDS), i.e. VASA service hasn't been enabled, there's no need to do anything.
wasabi
SolidFire v12 Backup and Restore with Wasabi S3
It's very easy and works as you expected:
gitops
Create and maintain SolidFire volumes and accounts with Terraform
NOTICE: all credentials and tokens on this page are samples, not leaked.
openstack
Kubernetes with Cinder CSI Plugin on Openstack Yoga/Xena with SolidFire 12.3 - Part 1
NOTICE: all credentials and tokens on this page are samples, not leaked.
cinder
Kubernetes with Cinder CSI Plugin on Openstack Yoga/Xena with SolidFire 12.3 - Part 1
NOTICE: all credentials and tokens on this page are samples, not leaked.
xena
Kubernetes with Cinder CSI Plugin on Openstack Yoga/Xena with SolidFire 12.3 - Part 1
NOTICE: all credentials and tokens on this page are samples, not leaked.
provisioning
Kubernetes with Cinder CSI Plugin on Openstack Yoga/Xena with SolidFire 12.3 - Part 1
NOTICE: all credentials and tokens on this page are samples, not leaked.
driver
Kubernetes with Cinder CSI Plugin on Openstack Yoga/Xena with SolidFire 12.3 - Part 1
NOTICE: all credentials and tokens on this page are samples, not leaked.
sql select
S3 Select vs. remote SQL access to CSV over FUSE
In a recent post I wrote about S3 Select in StorageGRID 11.6.
csv
S3 Select vs. remote SQL access to CSV over FUSE
In a recent post I wrote about S3 Select in StorageGRID 11.6.
sql
S3 Select vs. remote SQL access to CSV over FUSE
In a recent post I wrote about S3 Select in StorageGRID 11.6.
activeiq
Check Active IQ connectivity from HCC on SolidFire mNode
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
aiq
Check Active IQ connectivity from HCC on SolidFire mNode
One annoyance with Active IQ connectivity from Hybrid Cloud Control for SolidFire/NetApp HCI/eSDS is that it's not easy to tell what's going on with it when ...
photon
Back to top ↑curl
curl with native JSON support and SolidFire API
NOTICE: all credentials and tokens on this page are samples, not leaked.
s3tester
Evaluating ONTAP S3 performance with s3tester
ONTAP has had S3 service for a while now. While ONTAP S3 isn't meant to take over large and complex S3 workloads in which NetApp StorageGRID excels, it is mo...
kestra
Simplify data workflows with Kestra
Introduction
jupyter
Manage SolidFire from Jupyter Python or .NET notebooks
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
report
SolidFire capacity and efficiency report generator
NOTICE: any and all credentials and tokens on this page are samples, not leaked.
platform
On-prem Platform9 Managed Kubernetes with SolidFire
Introduction
pmk
On-prem Platform9 Managed Kubernetes with SolidFire
Introduction
rest server
Rest Server with NetApp E-Series
Introduction How it works Rest Server E-Series Dealing with the risk of storage-side snapshot rotation Storage efficiency Thi...
lvm
Consume SolidFire storage from Proxmox hosts
Configure Proxmox 7.1 with SolidFire 12.3 SolidFire Demo VM on Proxmox
ephemeral
Ephemeral volumes with BeeGFS CSI provisioner on Kubernetes
One of more obvious characteristics of Persistent Volumes is they persist, i.e. survive pod(s) that use them until the claim for the PV itself is deleted, as...
rest
Trident CSI REST API
Why access Trident API Controller routes Trident resources Expose the Trident REST API Examples What about it Appendix: List of Trident Resour...
object lock
SolidFire Backup to S3 with Object Lock
How would we use SolidFire Backup to S3 with Object Lock-enabled buckets Practical observations How many S3 objects or accounts do we need ...
tanzu
Kubernetes with vSphere CSI Plugin and NetApp E-Series
NetApp E-Series are fast-performing disk arrays frequently used by big data, analytics, video processing, NOSQL databases, and HPC applications. You can find...
economics
Rightsizing compute resources in the cloud with Spot.io
Most cloud users know about the various options to rent cloud compute resources.
apache
Apache Ozone S3 and NetApp E-Series
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
ozone
Apache Ozone S3 and NetApp E-Series
I'm supposed to be resting this week and that hasn't been working out… Still, I'll try to keep this one shorter than the previous two posts from this week.
milvus
Milvus with SolidFire and E-Series
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
lnn
Milvus with SolidFire and E-Series
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
vector database
Milvus with SolidFire and E-Series
WTF is Milvus Storage-related stuff Meta storage (etcd) Logs and queues Object store Storage efficiency High availabi...
cassandra
Cassandra with SolidFire and E-Series
Introduction
xen
XCP-ng and XOA with NetApp SolidFire iSCSI Storage Repositories
Introduction XCP-NG with SolidFire XOA Conclusion
xen server
XCP-ng and XOA with NetApp SolidFire iSCSI Storage Repositories
Introduction XCP-NG with SolidFire XOA Conclusion
QoS
Display per-storage node performance guarantees of SolidFire nodes
There's a PowerShell script sfvid2nid.ps1 in my Awesome SolidFire repository on Github. It produces a table that shows the mapping of volume IDs to node IDs.
nextflow
Leverage BeeGFS in Nextflow to avoid unnecessary data movement
Nextflow configuration and environment variables allow us to make use of BeeGFS with E-Series for most demanding IO tasks.
oracle
Oracle TimesTen Classic XE notes
Oracle TimesTen XE Classic v22.1 has quite a few requirements and settings related to memory and storage. Some attributes directly and indirectly related to ...
timesten
Oracle TimesTen Classic XE notes
Oracle TimesTen XE Classic v22.1 has quite a few requirements and settings related to memory and storage. Some attributes directly and indirectly related to ...
storage network
SolidFire Backup to S3 over Storage Network
Normally SolidFire 11 and 12 use Management Network for volume backup. Some users prefer to have backup flow over Storage Network.
sbom
SBOM with signed Apptainer containers on BeeGFS
Introduction Why Build data-app container and check its inventory Use it Conclusion
container
LXD containers and VMs on BeeGFS with NetApp E-Series
Introduction Why LXD on BeeGFS (with or without NetApp E-Series) Get started Optimal BeeGFS settings HA BeeGFS client in LXD VMs on LXD server a...
weka
Reading Weka's documentation
Weka has a nice documentation site based on GitBook. I love good documentation!
weka.io
Reading Weka's documentation
Weka has a nice documentation site based on GitBook. I love good documentation!
eoa
End of Availability for SolidFire
This week NetApp released product communique CPC-00467 (NetApp support portal login required) on end of availability of SolidFire.
end of availability
End of Availability for SolidFire
This week NetApp released product communique CPC-00467 (NetApp support portal login required) on end of availability of SolidFire.
tensorstore
TensorStore with BeeGFS
TensorStore is a new C++ and Python library that provides a uniform API for reading and writing n-dimensional data.
cloudflare
Hybrid cloud scenarios with Cloudflare serverless
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
workers
Hybrid cloud scenarios with Cloudflare serverless
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
containers
Hybrid cloud scenarios with Cloudflare serverless
Introduction Cloudflare scenarios for Hybrid Cloud users Experiment Conclusion
watch
BeeGFS filesystem event monitoring with watcher
Maybe you've used an app (or an ONTAP feature) that makes use of the FPolicy API. FPolicy is proven in large and busy NAS environments, and has rich features...
fsnotify
BeeGFS filesystem event monitoring with watcher
Maybe you've used an app (or an ONTAP feature) that makes use of the FPolicy API. FPolicy is proven in large and busy NAS environments, and has rich features...
hsm
iRODS or Robinhood HSM with BeeGFS
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
irods
iRODS or Robinhood HSM with BeeGFS
BeeGFS can work with different storage targets, so just like with Spectrum Scale it is possible to create a filesystem that spans across different disk media...
jwt
E-Series SANtricity API with JWT aka Bearer Tokens
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
auth
E-Series SANtricity API with JWT aka Bearer Tokens
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
token
E-Series SANtricity API with JWT aka Bearer Tokens
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
login
E-Series SANtricity API with JWT aka Bearer Tokens
Introduction API Check TLS Traditional login JWTs Use SANtricity Bearer Token Demo References Conclusion
script
PowerShell password change script for local user account on E-Series SANtricity OS
Long story short, password rotation scripts should directly use the SANtricity (or Web Services Proxy, if you can't get directly to SANtricity) API and not t...
directpv
E-Series in a Kubernetes environment with DirectPV, TopoLVM, CSI Driver LVM CSI drivers
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
topolvm
E-Series in a Kubernetes environment with DirectPV, TopoLVM, CSI Driver LVM CSI drivers
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
lvm csi
E-Series in a Kubernetes environment with DirectPV, TopoLVM, CSI Driver LVM CSI drivers
CSI choices for E-Series in a Kubernetes environment What's out there in terms of DAS CSI for Kubernetes Unique DAS approaches How ...
forwarding
Forward E-Series SANtricity logs to remote syslog server
Configure SANtricity to send array events to a remote syslog server
mel
Gathering and forwarding E-Series SANtricity Major Event Log (MEL)
E-Series Performance Analyzer (EPA) v3.0.0 collects MEL (Major Event Log) events and send them to InfluxDB. I think SANtricity syslog events have similar inf...
beeegfs
NetApp BeeGFS CSI driver 1.4.0
This week NetApp released BeeGFS CSI driver v1.4.0 which adds support for newer Kubernetes and BeeGFS.
spot
Burst on-prem GPU workloads from BeeGFS/E-Series clusters to Spot Ocean for Spark in the cloud
Problem statement Data replication Storage CSI drivers GPU compute nodes Performance monitoring Workflow
reporting
Like Flask, but with PowerShell
PowerShell (still) rocks PowerShell-based services Some ideas and use cases De-skill Kubernetes operations Provide RBAC to PowerShell...
scripting
Like Flask, but with PowerShell
PowerShell (still) rocks PowerShell-based services Some ideas and use cases De-skill Kubernetes operations Provide RBAC to PowerShell...
overprovisioning
Flash media overprovisioning on NetApp E-Series
Why overprovisioning exists Who needs this BeeGFS example Who doesn't need this Impact on capacity sizing Impact on deployment ...
Docker
Containerized Cloud Sync Data Broker for Docker, Kubernetes and Nomad
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
Nomad
Containerized Cloud Sync Data Broker for Docker, Kubernetes and Nomad
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
data broker
Containerized Cloud Sync Data Broker for Docker, Kubernetes and Nomad
Introduction Containerizing Data Broker Mounting and accessing data But, does it auto-scale? Demo Video demo
metrics
Use Cloud Sync API and Elasticsearch to improve data replication
Why and when automate Cloud Sync?
Elastic
Use Cloud Sync API and Elasticsearch to improve data replication
Why and when automate Cloud Sync?
Elasticsearch
Use Cloud Sync API and Elasticsearch to improve data replication
Why and when automate Cloud Sync?
KubeVirt
KubeVirt backup, restore with NetApp SolidFire & Kasten K10
Introduction KubeVirt VMs Snapshot and Backup Restore Demo Summary Update
VolSync
Backup and replicate Kubernetes PVs with SolidFire using VolSync
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
synchronization
Backup and replicate Kubernetes PVs with SolidFire using VolSync
Introduction VolSync Use cases Walk-through VolSync as generic backup and DR application Closing thoughts
projects
Visualize E-Series temperature and power consumption metrics with EPA
EPA v3.3.0 will be the next release of EPA and I'm aiming for two small improvements:
elastic
Elasticsearch performance with E-Series
Introduction Environment Elasticsearch performance in Docker Simple Web log indexing workload SIEM indexing workload Time-series database (TSDB)...
Kanister
Protect multi-volume Kubernetes applications with NetApp Trident and SolidFire
Introduction Cold multi-volume backup without snapshots Group Snapshot-assisted multi-volume backup Backup multi-volume snapshot to S3 with...
S3
Use cases for AWS mountpoint-s3 with NetApp E-Series and SolidFire
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
mountpoint-s3
Use cases for AWS mountpoint-s3 with NetApp E-Series and SolidFire
AWS mountpoint-s3 Deploy Use cases for E-Series and SolidFire S3 bucket as backup mountpoint Sub-bucket allocation ...
nfs
Zero-out and rethin VMDKs on NFS
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
flatcar linux
Zero-out and rethin VMDKs on NFS
A workaround for rethinning Create multiple NFS shares for ESXi Mount NFS shares in ESXi Create a VM with extra data disk on one of NFS shares Ens...
cloudcasa
CloudCasa, Velero, NetApp Trident, and SolidFire
Table of Contents
pvc
CloudCasa, Velero, NetApp Trident, and SolidFire
Table of Contents
cbl-mariner
Azure Linux with SolidFire iSCSI targets
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
azure
Azure Linux with SolidFire iSCSI targets
Now that Azure Linux is out, maybe some SolidFire users wonder if Azure Linux iSCSI can connect to SolidFire targets?
worm
Back to top ↑thanos
Back to top ↑proxy
Back to top ↑squid
Back to top ↑reverse proxy
Back to top ↑forward proxy
Back to top ↑fscrawler
Back to top ↑filesytem
Back to top ↑DDP
Back to top ↑pool
Back to top ↑preservation
Back to top ↑expand
Back to top ↑shrink
Back to top ↑gpt
Basic notes on h2o GPT from a storage perspective
So… I don't use Generative AI.
generative ai
Basic notes on h2o GPT from a storage perspective
So… I don't use Generative AI.
h2o
Basic notes on h2o GPT from a storage perspective
So… I don't use Generative AI.
lln
Basic notes on h2o GPT from a storage perspective
So… I don't use Generative AI.
statefulset
StatefulSet PVC Retention with Trident and SolidFire
Introduction
retention
StatefulSet PVC Retention with Trident and SolidFire
Introduction
policy
Back to top ↑snapmirror
SolidFire backup-to-S3 using ONTAP S3 destination
Introduction Backup to ONTAP S3 Network configuration Workflow Discussion Backup to ONTAP S3 DR to ONTAP S3 ...
polybase
Microsoft SQL Server data virtualization PolyBase with S3 Object Stores
What, why and how HTTP Access from SQL Server Where does Docker come in Other S3 clients Backup use case Comp...
memphis
Storage considerations for Memphis message broker
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
broker
Storage considerations for Memphis message broker
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
message broker
Storage considerations for Memphis message broker
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
queue
Storage considerations for Memphis message broker
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
streaming
Storage considerations for Memphis message broker
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
memphis.dev
Storage considerations for Memphis message broker
What is Memphis Storage-related observations Tiers S3 tier Disk and object storage (S3) considerations Conclusion
teradata
Teradata Vantage with NetApp S3 object stores
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
nos
Teradata Vantage with NetApp S3 object stores
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
delta lake
Teradata Vantage with NetApp S3 object stores
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
json
Teradata Vantage with NetApp S3 object stores
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
vantage
Teradata Vantage with NetApp S3 object stores
Introduction Teradata Vantage Impressive screenshot Choosing S3 Storage Officially supported Sequential performance Scale of ...
volumemode
Block volume mode in Kubernetes with SolidFire
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
fileystem
Block volume mode in Kubernetes with SolidFire
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
btrfs
Block volume mode in Kubernetes with SolidFire
Introduction Digression Purpose Volume mode in PVC How does this help us with git clone problem Conclusion...
backblaze
SolidFire backup-to-S3 with Backblaze
I've written a dozen posts about SolidFire's "backup to S3", so I'll just skip all that and focus on Backblaze.
sample
Using synthetic SolidFire S3 backups for Dev/Test purposes
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
volume
Using synthetic SolidFire S3 backups for Dev/Test purposes
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
synthetic
Using synthetic SolidFire S3 backups for Dev/Test purposes
Why Automation Generate data and backup volumes Restore S3 backups to new SolidFire volumes Restore-related notes Cost estimati...
dpp
MinIO Erasure Coding with NetApp E-Series
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
ef300
MinIO Erasure Coding with NetApp E-Series
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
ef600
MinIO Erasure Coding with NetApp E-Series
The concept Recommendations Single rack Three racks Non-standard EC:1 on VI/K8s with E-Series Tolerance to disk loss ...
simple backups
Use Simple Backups to file-backup cloned SolidFire volumes to S3/B2
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
simplebackups
Use Simple Backups to file-backup cloned SolidFire volumes to S3/B2
What is Simple Backups? Use Simple Backups for File-type backup with SolidFire clones mounted to a "backup VM" Backup sizes compared to Solid...
mib
Event monitoring with SNMP trap notifications from NetApp E-Series arrays
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
oid
Event monitoring with SNMP trap notifications from NetApp E-Series arrays
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
INF-01-00
Event monitoring with SNMP trap notifications from NetApp E-Series arrays
Introduction Configure SNMP trap destination in SANtricity OS Get E-Series MIB files and OID SANtricity SNMP walk SANtricity SNMP traps and trap e...
rdma
Ubuntu 22.04 LTS as iSER client to NetApp E-Series
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
iser
Ubuntu 22.04 LTS as iSER client to NetApp E-Series
Problem statement E-Series side Ubuntu side Hardware and software stack Setup workflow Tips and tricks SANtricity Host settings ...
prtg
Monitoring NetApp E-Series with PRTG
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
traps
Monitoring NetApp E-Series with PRTG
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
custom
Monitoring NetApp E-Series with PRTG
Introduction Software stack Getting E-Series events and metrics into PRTG Generic probes SNMP walk SNMP traps Custom sens...
cg
Stand-alone and Consistency Group snapshots on NetApp E-Series
How does it work? Limits Thin or thick? How much to reserve for SANtricity snapshots? What can we do with SANtricity snapshots and clones ...
volume group
Benefits of RAID 1 in E-Series DDP
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
raid1
Benefits of RAID 1 in E-Series DDP
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
raid6
Benefits of RAID 1 in E-Series DDP
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
r10
Benefits of RAID 1 in E-Series DDP
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
r1
Benefits of RAID 1 in E-Series DDP
What is this about again? Why is RAID 1 on DDP a good idea? Is R1 on DDP really faster? Which workloads can benefit from mixed RAID 1 and RAID 6 vol...
repository
Monitor snapshot and clone repositories of NetApp E-Series SANtricity OS
Problem statement Considerations First iteration Second iteration Conclusion
RAID 1
Faster PostgreSQL with DDP-based RAID 1 compared to DDP-based RAID 6
Introduction Environment Tests Results Other performance views Conclusion
RAID 6
Faster PostgreSQL with DDP-based RAID 1 compared to DDP-based RAID 6
Introduction Environment Tests Results Other performance views Conclusion
R1
Faster PostgreSQL with DDP-based RAID 1 compared to DDP-based RAID 6
Introduction Environment Tests Results Other performance views Conclusion
pgbench
Faster PostgreSQL with DDP-based RAID 1 compared to DDP-based RAID 6
Introduction Environment Tests Results Other performance views Conclusion
e-series perf analyzer
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
psu
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
temperature
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
sensors
E-Series Perf Analyzer (EPA) v3.3.0
Introduction Power Temperature What does V3.3.0 do for expansion shelves? What's next for EPA? Database Grafana Other wish-...
hec
Back to top ↑http event collector
Back to top ↑element
Back to top ↑postgres
Postgres, pgvector, E-Series and Instaclustr
NOTICE: all credentials and tokens on this page are samples, not leaked.
pgvector
Postgres, pgvector, E-Series and Instaclustr
NOTICE: all credentials and tokens on this page are samples, not leaked.
RAG
Postgres, pgvector, E-Series and Instaclustr
NOTICE: all credentials and tokens on this page are samples, not leaked.
nvidia
Deceptive nvidia-smi output
I'm curious if I should buy a more expensive GPU so I use nvidia-smi to see how busy the current one is.
delegation
RBAC and delegation for SolidFire JSON-RPC API with Lua
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
roles
RBAC and delegation for SolidFire JSON-RPC API with Lua
Introduction Fixing RBAC with a TLS-terminating reverse proxy Lua in reverse proxy path JSON-RPC Lua and JSON-RPC Complicate things...
trim
UNMAP/TRIM Hyper-V volumes backed by NetApp SolidFire
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
retrim
UNMAP/TRIM Hyper-V volumes backed by NetApp SolidFire
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
ntfs
UNMAP/TRIM Hyper-V volumes backed by NetApp SolidFire
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
sdelete
UNMAP/TRIM Hyper-V volumes backed by NetApp SolidFire
Introduction General notes on NTFS rehinning and SolidFire QoS-related tips Prepare Windows host volume SDelete SDelete with Windows gu...
pytorch
PyTorch checkpointing workload with NetApp E-Series
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
torch
PyTorch checkpointing workload with NetApp E-Series
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
load
PyTorch checkpointing workload with NetApp E-Series
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
save
PyTorch checkpointing workload with NetApp E-Series
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
distributed
PyTorch checkpointing workload with NetApp E-Series
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
checkpoint
PyTorch checkpointing workload with NetApp E-Series
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
dcp
PyTorch checkpointing workload with NetApp E-Series
Introduction Torch checkpoints Filesystem format, path and files Example Storage considerations File system considerations S3 vs cluster file ...
autoscaling
Kubernetes KEDA with NetApp SolidFire and E-Series
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
keda
Kubernetes KEDA with NetApp SolidFire and E-Series
Introduction KEDA concepts and components Scalers KEDA and persistent storage SolidFire E-Series Storage-related events ...
hardened
NetApp E-Series DAS or SAN storage as Veeam Hardened Repository
Introduction Longer answer Other notes Disk snapshots and security E-Series vs. internal RAID Hardened repository volumes on E-Series w...
AV
Scan NetApp StorageGRID S3 buckets for viruses and malware
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
antivirus
Scan NetApp StorageGRID S3 buckets for viruses and malware
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
antimalware
Scan NetApp StorageGRID S3 buckets for viruses and malware
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
scan
Scan NetApp StorageGRID S3 buckets for viruses and malware
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
virus
Scan NetApp StorageGRID S3 buckets for viruses and malware
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
malware
Scan NetApp StorageGRID S3 buckets for viruses and malware
Introduction Problem description Getting started with a DIY approach Example A smarter approach Preempting and deleting trouble-causing uploads ...
sds
NetApp StorageGRID on VMware
Introduction Network Servers StorageGRID load balancer OS Storage Flash tier NL-SAS tier DDP vs RAID Gro...
broadcom
VMware license calculator for VVF and VCF
Introduction VMware's calculator (KB 96426) Example for NetApp HCI Conclusion
licensing
VMware license calculator for VVF and VCF
Introduction VMware's calculator (KB 96426) Example for NetApp HCI Conclusion
notifications
Kafka notifications in NetApp StorageGRID 11.8
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
confluent
Kafka notifications in NetApp StorageGRID 11.8
Introduction How to configure What do Kafka notifications look like Similarities and differences compared to Elasticsearch search integration Use ...
fast_dedup
ZFS deduplication with NetApp E-Series
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
dedup
ZFS deduplication with NetApp E-Series
Introduction What's new with ZFS deduplication ZFS and E-Series Benefits of using ZFS with E-Series Deduplication Compression ...
incus
ZFS with NetApp E-Series
Introduction What is E-Series anyway Easy storage management Conclusion
media scan
Monitor progress and notify of E-Series media scan events
Introduction SANtricity API methods related to scrubbing, scanning, fixing data issues Media scan in Web UI Relevant API methods Implementation ...
grok
Analyze HTTP logs from NetApp StorageGRID gateway nodes
Introduction Log format What needs to happen Parsing with Grok Result Caveats Why you probably don't need this (but another team may) ...
xfs
Filesystem block size used by NetApp StorageGRID
So, what filesystem block size does StorageGRID 11.8 use?
block size
Filesystem block size used by NetApp StorageGRID
So, what filesystem block size does StorageGRID 11.8 use?
verda
Use Velero with NetApp Verda and Trident CSI
What is Verda Example with Redis Conclusion
ssd cache
SSD Cache feature on NetApp SANtricity E-Series
WTH is "SSD Cache" Create SSD cache Configure HDD-based volumes to use SSD Cache Summary API for monitoring
best practices
NetApp StorageGRID networks
Introduction
firewall
NetApp StorageGRID networks
Introduction
beegfs csi
NetApp E-Series with containerized BeeGFS, NFS, S3
Introduction Reinventing the wheel Components Workflow Expected outcome Next steps Security Quotas and ACLs Monitoring ...
elementos
OpenAPI and SolidFire
SolidFire doesn't have an OpenAPI interface. See here.
json-rpc
OpenAPI and SolidFire
SolidFire doesn't have an OpenAPI interface. See here.
jsonrpc
OpenAPI and SolidFire
SolidFire doesn't have an OpenAPI interface. See here.
123456
Remove password complexity requirements on Ubuntu 24.04 LTS
Busybodies@work I want 123456 Ending Appendix A: recommended low-quality password settings for pwquality.conf
histograms
Make use of storage QoS histograms on NetApp SolidFire
Intro About QoS histograms on NetApp SolidFire Request Response What are these things? Bucket naming Should you use QoS histogram information?...
schedule
Snapshots and snapshot schedules in SFC v2
Introduction
failover
Kubefire - tools and recipes for Kubernetes failover/failback with SolidFire
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
failback
Kubefire - tools and recipes for Kubernetes failover/failback with SolidFire
Introduction Kubefire Simplified version of Longhorny focused on Kubernetes Automated replication service for SolidFire replication in ...
aws
Velero AWS Plugin and SignatureDoesNotMatch nonsense
Introduction Before After Workarounds HTTPS weirdness Conclusion Appendix A - ONTAP S3 backup listing and Velero backup descr...
rcos
Boot OpenShift RCOS from NetApp SolidFire iSCSI target
Introduction How Other SolidFire-related tips Conclusion
openshift
Boot OpenShift RCOS from NetApp SolidFire iSCSI target
Introduction How Other SolidFire-related tips Conclusion
ublock
Fixing Web UI annoyances with element blocking
While using ehm, a famous S3 server, I got annoyed by this stupid red dot.
red dot
Fixing Web UI annoyances with element blocking
While using ehm, a famous S3 server, I got annoyed by this stupid red dot.
netapp e-series
Using NetApp E-Series Volume Copy
What is a volume created by Volume Copy operation How does it work? Progress Reserve size Reserve location Priority Automating Volume Copy A...
volume copy
Using NetApp E-Series Volume Copy
What is a volume created by Volume Copy operation How does it work? Progress Reserve size Reserve location Priority Automating Volume Copy A...
harvest
Minimal Prometheus Exporter with ONTAP Harvest
Introduction Approach Steps One or more instances Prepare your box Clone Harvest repo or download pre-built container image ...
cloudera
Cloudera Base with NetApp E-Series
Introduction Reference architectures High-level design and best practices What's new in Cloudera Base Deployment topology Sizin...
tiering
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
deduplication
ThinkParQ BeeGFS v8 with NetApp E-Series
Introduction Data tiering with pools ZFS BeeGFS snapshots Role of snapshots Cognitive overhead of ZFS BeeGFS copy too...
agent
Build NetApp SolidFire MCP server
Introduction MCP Use cases? Get, set, and security Conclusion Additional reading
opea
OPEA AI with NetApp E-Series
Introduction What is the OPEA project The stack Docker vs. Kubernetes Where's the storage? E-Series storage and solution stack ...
2025
Windows Server 2025 with NetApp SolidFire
I wrote about Windows Server 2025 here.
server
Windows Server 2025 with NetApp SolidFire
I wrote about Windows Server 2025 here.
data pipeline
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
thinkparq
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
mlops
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
stack
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
reference
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
spark
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
TR-4890
Data pipelines with ThinParQ BeeGFS and NetApp E-Series
Introduction BeeGFS file-system events and indexes Dispatch jobs for data operations Near real-time vs scheduled processing Near real-tim...
scanning
Simple file share and S3 analytics and MCP ops
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
enumeration
Simple file share and S3 analytics and MCP ops
Introduction SMB and NFS data migration Shell scripts and utilities XCP Elaborate schemes Enterprise software Example...
aistor
What is MinIO up to these days?
"Adjustments" Latest and greatest: "breaking changes" Are you telling me there's a chance? Thoughts Risk and commercial ...
pve
Firemox - an anti-plugin for Proxmox PVE with NetApp SolidFire
Background Firemox What it does, and doesn't (Stopping) scope creep Known issues and limitations Conclusion Demo and source c...
group snapshot
The shocking truth about SolidFire ModifySchedule method
Introduction Show me Why? Thoughts Conclusion
opensearch
S3 GO NATS!
Part 1 - S3 vector search: S3 vector search - DIY vs AWS S3 Vectors Part 2 - S3 vector search: S3 GO NATS! (this post)
hcl
Updated Terraform provider for SolidFire
Introduction What's new in 2025 Next steps
EPA
E-Series Performance Analyzer (EPA) v4 beta
Introduction EPA 4 EPA Collector-specific Details related to storage requirements What's next